-- Logs begin at Mon 2022-07-11 20:12:39 UTC, end at Mon 2022-07-11 21:21:43 UTC. -- Jul 11 20:48:35.570559 dv-cinder-849022-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 20:48:35.579828 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 20:48:35 2022] *** Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: nodename: dv-cinder-849022-2-iscsi Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: machine: x86_64 Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: clock source: unix Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: pcre jit disabled Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: detected number of CPU cores: 4 Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: current working directory: / Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: detected binary path: /usr/bin/uwsgi-core Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: your processes number limit is 47680 Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: your memory page size is 4096 bytes Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: detected max file descriptor number: 2048 Jul 11 20:48:35.582069 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: lock engine: pthread robust mutexes Jul 11 20:48:35.583006 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: thunder lock: enabled Jul 11 20:48:35.583006 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 20:48:35.583006 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 20:48:35.625440 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: Python main interpreter initialized at 0x56258cef39c0 Jul 11 20:48:35.625440 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: python threads support enabled Jul 11 20:48:35.625440 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: your server socket listen backlog is limited to 100 connections Jul 11 20:48:35.625440 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: your mercy for graceful operations on workers is 90 seconds Jul 11 20:48:35.625797 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 20:48:35.625797 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: *** Operational MODE: preforking *** Jul 11 20:48:35.626087 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: *** uWSGI is running in multiple interpreter mode *** Jul 11 20:48:35.626087 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: spawned uWSGI master process (pid: 103304) Jul 11 20:48:35.626282 dv-cinder-849022-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 20:48:35.626879 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: spawned uWSGI worker 1 (pid: 103305, cores: 1) Jul 11 20:48:35.627123 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: spawned uWSGI worker 2 (pid: 103306, cores: 1) Jul 11 20:48:35.627286 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 20:48:36.275986 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 20:48:36.279403 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 20:48:37.387875 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:48:37.387875 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: from cryptography.utils import int_from_bytes Jul 11 20:48:37.388560 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:48:37.388560 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: from cryptography.utils import int_from_bytes Jul 11 20:48:37.388675 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:48:37.388675 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: from cryptography.utils import int_from_bytes Jul 11 20:48:37.388675 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:48:37.388675 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: from cryptography.utils import int_from_bytes Jul 11 20:48:39.844324 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 20:48:39.844855 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 20:48:39.844855 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 20:48:39.845254 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 20:48:39.845336 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 20:48:39.845419 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 20:48:39.845506 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 20:48:39.845593 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 20:48:39.845678 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 20:48:39.845744 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 20:48:39.846058 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.846200 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.846346 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.846438 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.846690 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.846819 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.846991 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.847102 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.847326 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.847464 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.847642 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.847810 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.848032 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.848172 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.848385 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.848483 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.848711 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.848818 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.848961 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.849062 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.849278 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.849366 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.849596 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849022-2-iscsi {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.849755 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849022-2-iscsi {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.849911 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.850009 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.850212 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.850308 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.850517 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.850618 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.850828 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.850926 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.851126 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.851220 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.851445 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.851534 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.851726 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.851817 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.852245 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.852366 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.853476 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.853570 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.853639 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.853712 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.853779 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.853858 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.853925 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.853989 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.854054 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.854125 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.854193 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.854269 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.854488 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.854601 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.854808 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.854904 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.855120 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.855219 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.855423 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.855512 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.855820 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849022-2-iscsi {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.855918 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849022-2-iscsi {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.856195 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.856296 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.856462 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.856549 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.856743 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.856856 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.857152 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.857261 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.857458 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.857543 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.857765 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.857848 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.858079 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.858164 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.858396 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.858497 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.858701 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.858846 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.859024 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.859110 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.859338 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.859422 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.859652 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.859755 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.859967 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.860057 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.860291 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.860393 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.860599 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.860692 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.860904 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.860990 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.861217 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.861311 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.861516 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.861689 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.861815 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.861899 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.862067 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.862219 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.862367 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.862476 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.862680 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.862772 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.862995 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.863085 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.863352 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.863482 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.863634 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.863736 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.863860 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.864143 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.864288 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.864474 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.864615 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.864853 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.864952 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.865103 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.865223 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.865412 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.865532 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.865718 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.865845 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.866026 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.866150 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.866332 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.866458 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.866638 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.866765 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.866942 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.867071 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.867246 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.867389 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.867566 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.867705 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.867880 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.868025 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.868223 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.868353 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.868531 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.868673 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.868847 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.869072 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.869246 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.869331 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.869496 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.869616 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.869804 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.869955 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.870143 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.870276 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.870459 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.870588 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.870769 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.870906 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.871085 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.871230 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.871403 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.871538 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.871708 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.871844 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.872015 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.872171 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.872350 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.872493 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.872669 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.872825 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.873005 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.873131 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.873324 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.873454 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.873557 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.873652 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.873855 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.873958 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.874156 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.874250 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.874473 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.874558 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.874777 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.874875 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.875080 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.875168 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.875383 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.875467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.875682 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.875777 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.875985 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.876076 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.876319 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.876405 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.876625 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.876729 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.876927 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.877019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.877230 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.877324 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.877532 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.877624 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.877836 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.877921 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.878138 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.878221 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.878441 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.878527 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.878758 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.878842 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.879108 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.879214 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.879415 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.879555 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.879817 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.879905 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.880141 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.880245 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.880447 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.880542 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.880767 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.880861 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.881068 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.881162 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.881369 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.881465 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.881677 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.881760 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.881982 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.882066 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.882280 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.882375 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.882590 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.882680 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.882890 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.882975 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.883193 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.883279 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.883487 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.883570 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.883791 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.883877 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.884093 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.884206 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.884423 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.884510 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.884725 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.884829 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.885023 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.885139 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.885318 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.885401 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.885617 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.885716 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.885916 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.886002 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.886212 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.886303 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.886507 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.886605 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.886802 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.886888 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.887097 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.887181 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.887412 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.887511 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.887716 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.887806 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.888019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.888157 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.888342 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.888512 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.888641 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.888733 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.888961 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:48:39.889047 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.889295 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.889381 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.889625 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.889715 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.889936 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.890027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.890264 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.890349 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.890593 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.890678 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.890914 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.890998 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.891225 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.891310 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.891536 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.891624 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.891851 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.891950 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.892183 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.892270 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.892495 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.892583 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.892806 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.892898 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.893116 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.893211 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.893430 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.893518 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.893761 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.893866 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.894077 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.894164 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.894390 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.894476 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.894751 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.894895 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.895065 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.895222 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.895517 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.895615 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.895839 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.895945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.896191 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.896279 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.896505 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.896594 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.896814 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.896910 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.897157 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.897243 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.897472 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.897556 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.897796 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.897890 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.898113 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.898198 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.898425 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.898511 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.898733 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.898832 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.899039 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.899124 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.899345 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.899442 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.899665 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.899759 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.900001 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.900119 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.900312 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.900401 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.900620 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.900706 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.900924 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.901009 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.901228 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.901312 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.901532 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.901617 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.901839 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.901924 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.902143 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.902237 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.902473 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.902557 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.902783 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.902866 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.903090 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.903183 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.903395 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.903480 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.903702 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.903786 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.904008 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.904164 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.904340 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.904424 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.904639 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.904790 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.904941 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.905042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.905243 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.905362 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.905544 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.905633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.905850 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.905951 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.906151 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.906236 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.906468 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.906585 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.906779 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.906864 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.907084 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.907168 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.907405 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.907488 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.907704 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.907792 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.908010 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.908097 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.908343 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.908431 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.908648 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.908750 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.908957 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.909042 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.909267 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.909357 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.909573 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.909667 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.909895 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.910001 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.910292 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.910505 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.910656 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.910831 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.910973 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.911157 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.911296 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.911581 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.911731 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.911856 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.911975 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.912094 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.912249 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.912389 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.912531 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.912678 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.912990 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.913122 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.913253 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.913403 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.913533 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.913671 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.913770 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.913909 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.914048 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.914183 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.914317 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.914511 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.914605 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.914812 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.914912 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.915116 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.915203 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.915436 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.915593 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.915758 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.915858 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.916070 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.916183 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.916394 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.916481 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.916704 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.916791 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.917003 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.917095 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.917306 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.917393 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.917605 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.917701 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.917912 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.917998 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.918211 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.918295 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.918509 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.918601 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.918807 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.918893 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.919109 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.919194 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.919409 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.919502 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.919724 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.919809 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.920025 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.920157 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.920351 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.920446 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.920649 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.920734 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.920948 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.921043 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.921290 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.921375 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.921592 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.921705 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.921929 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.922027 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.922260 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.922345 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.922576 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.922664 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.922895 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.922993 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.923205 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.923289 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.923520 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.923608 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.923827 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.923916 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.924154 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.924255 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.924468 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.924633 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.924776 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.924862 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.925090 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.925182 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.925397 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.925490 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.925715 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.925814 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.926083 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.926178 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.926406 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.926506 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.926712 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.926844 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.927027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.927113 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.927327 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.927425 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.927638 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.927724 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.927974 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.928059 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.928324 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.928424 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.928644 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.928728 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.928960 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.929055 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.929267 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.929361 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.929578 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.929665 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.929882 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.929970 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.930191 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.930295 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.930497 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.930585 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.930803 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.931118 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.931426 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.931528 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.931740 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.931834 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.932046 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.932191 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.932392 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.932497 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.932700 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.932792 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.933017 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.933103 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.933318 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.933406 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.933628 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.933722 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.933933 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.934018 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.934250 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.934343 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.934561 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.934653 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.934931 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.935027 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.935192 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.935289 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.935501 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.935594 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.935806 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.935891 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.936129 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.936221 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.936439 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.936526 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.936740 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.936840 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.937045 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.937140 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.937351 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.937436 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.937656 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.937751 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.937963 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.938049 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.938266 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.938366 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.938576 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.938670 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.938882 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.938976 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.939179 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.939263 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.939481 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.939577 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.939782 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.939866 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.940087 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.940194 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.940419 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.940508 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.940737 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.940823 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.941044 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.941129 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.941342 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.941439 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.941674 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.941964 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.942102 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.942201 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.942291 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.942870 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.942958 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.943194 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.943280 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.943506 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.943601 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.943814 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.943908 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.944156 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.944247 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.944444 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.944532 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.944755 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.944839 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.945076 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.945161 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.945377 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.945464 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.945690 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.945775 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.945998 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.946084 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.946306 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.946391 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.946623 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.946715 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.946930 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.947052 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.947235 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.947329 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.947542 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.947636 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.947850 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.947954 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.948177 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.948265 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.948488 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.948573 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.948795 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.948893 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.949106 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.949193 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.949412 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.949497 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.949719 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.949814 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.950019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.950106 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.950325 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.950410 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.950634 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.950729 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.950938 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.951220 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.951306 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.951546 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.951640 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.951858 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.952143 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.952275 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.952475 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.952562 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.952792 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.952887 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.953109 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.953196 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.953429 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.953522 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.953749 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.953836 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.954061 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.954159 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.954370 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.954459 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.954677 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.954772 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.954979 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.955075 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.955289 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.955376 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.955593 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.955681 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.955894 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.955979 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.956217 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.956320 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.956526 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.956614 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.956826 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.956913 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.957179 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.957276 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.957491 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.957595 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.957800 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.957909 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.958102 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.958192 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.958402 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.958498 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.958707 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.958801 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.959020 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.959110 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.959324 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.959420 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.959636 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.959723 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.959935 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.960021 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.960261 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.960369 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.960568 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.960664 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.960872 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.960970 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.961173 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.961269 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.961476 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.961562 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.961816 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.961913 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.962121 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.962256 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.962439 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.962526 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.962746 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.962832 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.963064 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.963153 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.963366 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.963461 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.963668 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.963771 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.963964 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.964051 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.964296 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.964385 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.964598 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.964683 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.964893 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.964981 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.965199 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.965284 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.965499 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.965593 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.965798 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.965892 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.966100 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.966227 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.966400 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.966495 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.966706 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.966792 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.967005 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.967091 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.967301 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.967394 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.967608 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.967693 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.967906 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.968001 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.968224 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.968327 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.968531 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.968626 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.968832 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.968923 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.969129 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.969215 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.969433 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.969521 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.969732 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.969818 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.970030 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.970116 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.970331 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.970416 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.970630 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.970714 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.970924 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.971016 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.971232 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.971319 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.971529 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.971614 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.971826 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.971911 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.972158 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.972244 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.972467 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.972569 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.972876 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.972987 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.973203 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.973291 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.973514 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.973673 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.973817 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.973979 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.974119 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.974282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.974426 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.974592 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.974728 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.974914 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.975030 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.975229 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.975324 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.975533 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.975644 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.975845 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.975958 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.976172 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.976313 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.976479 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.976595 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.976782 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.976903 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.977089 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.977209 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.977392 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.977514 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.977693 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.977821 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.977993 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.978125 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.978294 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.978430 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.978595 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.978735 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.978920 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.979043 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.979229 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.979346 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.979532 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.979670 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.979833 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.979979 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.980155 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.980312 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.980500 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.980615 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.980803 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.980920 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.981162 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.981252 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.981469 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.981556 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.981786 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.981897 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.982108 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.982194 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.982416 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.982502 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.982725 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.982813 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.983037 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.983131 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.983341 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.983435 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.983655 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.983750 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.983961 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.984047 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.984297 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.984399 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.984606 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.984701 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.984908 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.984995 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.985207 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.985301 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.985512 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.985605 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.985817 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.985902 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.986125 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.986220 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.986439 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.986525 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.986755 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.986847 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.987056 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.987151 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.987364 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.987449 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.987664 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.987757 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.987965 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.988095 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.988353 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.988474 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.988674 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.988877 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.988973 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.989201 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.989288 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.989511 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.989598 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.989821 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.989926 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.990132 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.990220 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.990440 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.990527 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.990745 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.990839 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.991054 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.991141 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.991357 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.991442 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.991660 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.991754 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.991960 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.992045 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.992306 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.992394 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.992606 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.992693 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.992906 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.992992 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.993206 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.993292 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.993507 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.993594 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.993806 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.993898 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.994108 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.994239 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.994537 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.994624 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.994845 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.994930 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.995149 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.995243 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.995451 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.995537 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.995755 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.995839 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.996059 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.996198 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.996394 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.996531 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.996697 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.996784 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.996996 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.997111 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.997408 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.997502 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.997713 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.997802 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.998015 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.998110 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.998315 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.998418 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.998613 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.998710 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.998912 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.998999 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.999216 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.999311 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.999518 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.999603 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.999818 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:39.999905 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.000134 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.000222 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.000437 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.000525 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.000740 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.000827 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.001040 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.001125 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.001358 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.001447 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.001746 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.001833 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.002049 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.002135 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.002347 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.002461 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.002759 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.002856 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.003062 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.003155 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.003365 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.003459 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.003684 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.003769 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.004023 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.004134 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.004365 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.004565 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.004677 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.004968 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.005055 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.005276 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.005362 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.005596 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.005682 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.005922 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.006008 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.006231 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.006316 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.006543 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.006628 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.006847 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.006934 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.007167 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.007252 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.007488 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.007587 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.007800 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.007889 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.008144 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.008266 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.008542 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.008644 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.008858 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.008944 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.009162 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.009247 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.009480 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.009598 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.009804 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.009928 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.010107 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.010231 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.010406 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.010536 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.010720 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.010849 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.011021 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.011152 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.011324 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.011453 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.011646 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.011775 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.011947 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.012079 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.012279 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.012409 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.012585 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.012719 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.012892 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.013026 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.013196 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.013328 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.013499 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.013629 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.013819 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.013949 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.014120 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.014253 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.014436 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.014572 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.014750 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.014881 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.015068 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.015200 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.015386 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.015515 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.015691 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.015818 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.016013 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.016160 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.016349 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.016469 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.016651 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.016761 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.016953 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.017060 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.017254 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.017348 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.017593 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.017693 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.017899 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.017989 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.018217 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.018303 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.018546 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.018643 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.018868 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.018963 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.019175 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.019270 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.019502 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.019631 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.019871 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.020023 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.020208 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.020510 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.020609 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.020833 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.020919 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.021135 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.021231 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.021435 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.021523 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.021733 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.021818 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.022030 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.022115 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.022331 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.022429 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.022627 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.022712 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.022925 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.023011 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.023220 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.023307 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.023519 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.023612 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.023812 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.023897 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.024158 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.024247 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.024436 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.024537 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.024735 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.024820 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.025044 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.025145 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.025346 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.025441 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.025645 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.025745 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.025939 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.026034 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.026233 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.026325 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.026565 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.026660 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.026860 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.026953 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.027190 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.027277 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.027503 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.027599 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.027818 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.027950 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.028133 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.028222 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.028459 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.028559 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.028773 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.028859 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.029083 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.029168 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.029398 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.029484 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.029710 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.029795 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.030022 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.030114 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.030333 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.030479 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.030653 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.030779 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.031006 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.031093 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.031314 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.031400 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.031625 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.031719 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.031935 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.032023 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.032283 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.032478 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.032803 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.032890 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.033115 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.033281 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.033425 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.033511 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.033734 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.033819 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.034044 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.034140 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.034354 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.034447 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.034662 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.034747 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.034970 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.035117 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.035349 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.035442 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.035684 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.035868 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.036015 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.036367 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.036651 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.036740 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.036989 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.037085 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.037313 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.037399 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.037629 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.037719 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.037944 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.038033 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.038258 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.038346 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.038611 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.038703 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.038925 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.039073 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.039230 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.039319 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.039543 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.039630 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.039859 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.039958 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.040199 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.040288 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.040511 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.040610 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.040823 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.040912 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.041136 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.041223 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.041445 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.041531 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.041755 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.041851 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.042064 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.042157 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.042375 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.042468 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.042684 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.042770 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.042994 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.043131 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.043312 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.043414 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.043624 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.043719 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.043935 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.044021 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.044273 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.044376 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.044591 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.044678 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.044899 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.045111 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.045209 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.045425 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.045512 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.045759 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.046023 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.046118 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.046339 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.046426 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.046670 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.046792 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.046992 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.047079 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.047313 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.047409 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.047619 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.047706 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.047921 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.048008 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.048253 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.048345 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.048563 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.048703 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.048869 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.048956 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.049190 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.049278 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.049500 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.049595 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.049803 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.049900 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.050119 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.050206 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.050424 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.050510 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.050728 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.051008 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.051141 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.051452 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.051537 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.051848 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.051992 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.052204 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.052370 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.052534 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.052691 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.052853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.053020 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.053164 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.053344 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.053489 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.053661 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.053799 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.053970 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.054107 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.054293 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.054424 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.054598 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.054735 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.054904 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.055037 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.055219 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.055347 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.055530 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.055659 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.055832 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.055967 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.056155 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.056307 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.056468 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.056617 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.056777 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.056948 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.057082 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.057244 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.057391 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.057550 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.057693 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.057857 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.058019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.058159 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.058324 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.058470 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.058628 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.058781 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.058942 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.059081 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.059222 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.059384 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.059529 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.059686 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.059831 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.059997 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.060154 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.060327 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.060457 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.060632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.060770 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.060937 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.061071 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.061246 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.061376 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.061548 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.061678 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.061858 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.062014 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.062201 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.062368 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.062522 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.062658 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.062827 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.063042 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.063175 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.063321 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.063458 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.063589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.063721 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.063862 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.064029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.064181 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.064366 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.064504 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.064678 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.064813 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.065001 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.065135 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.065312 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.065454 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.065656 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.065841 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.065976 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.066174 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.066519 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.066700 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.066848 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.066997 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.067150 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.067282 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.067820 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.067964 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.068163 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.068269 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.068454 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.068549 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.068763 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.068897 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.069066 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.069155 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.069372 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.069457 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.069682 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.069778 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.069987 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.070073 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.070289 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.070374 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.070591 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.070685 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.070893 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.070978 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.071196 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.071288 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.071498 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.071584 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.071801 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.071886 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.072119 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.072209 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.072426 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.072522 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.072729 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.072822 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.073032 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.073122 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.073339 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.073427 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.073651 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.073738 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.073964 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.074058 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.074278 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.074367 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.074589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.074674 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.074893 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.074987 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.075200 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.075287 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.075503 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.075595 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.075810 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.075905 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.076138 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.076228 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.076446 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.076533 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.076758 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.076845 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.077062 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.077150 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.077373 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.077480 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.077677 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.077791 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.078094 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.078181 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.078402 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.078488 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.078704 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.078799 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.079019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.079104 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.079330 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.079428 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.079635 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.079722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.079953 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.080039 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.080282 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.080383 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.080604 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.080689 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.080910 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.080996 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.081235 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.081333 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.081553 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.081639 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.081857 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.081952 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.082291 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.082392 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.082533 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.082620 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.082835 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.082920 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.083134 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.083220 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.083439 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.083531 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.083737 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.083824 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.084035 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.084192 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.084359 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.084446 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.084656 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.084741 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.084955 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.085057 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.085251 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.085337 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.085545 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.085640 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.085843 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.085928 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.086140 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.086227 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.086438 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.086533 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.086732 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.086818 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.087029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.087115 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.087323 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.087422 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.087619 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.087706 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.087914 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.087999 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.088236 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.088338 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.088541 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.088630 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.088838 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.088924 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.089136 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.089221 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.089431 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.089524 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.089731 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.089817 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.090027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.090115 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.090352 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.090438 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.090668 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.090754 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.090976 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.091063 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.091291 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.091375 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.091597 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.091681 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.091910 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.092006 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.092243 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.092332 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.092553 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.092651 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.092860 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.092954 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.093166 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.093251 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.093472 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.093572 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.093776 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.093862 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.094084 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.094178 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.094388 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.094484 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.094690 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.094776 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.094994 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.095079 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.095296 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.095389 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.095603 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.095690 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.095915 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.096002 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.096257 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.096358 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.096562 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.096650 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.096875 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.096960 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.097185 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.097271 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.097490 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.097583 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.097827 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.097917 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.098133 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.098221 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.098440 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.098525 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.098748 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.098850 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.099052 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.099138 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.099359 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.099452 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.099665 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.099761 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.099971 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.100065 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.100308 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.100396 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.100620 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.100720 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.100925 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.101018 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.101248 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.101334 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.101551 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.101646 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.101873 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.101960 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.102190 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.102314 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.102527 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.102613 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.102835 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.102922 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.103142 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.103227 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.103452 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.103539 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.103753 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.103846 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.103993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 20:48:40.104090 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.104386 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:48:40.104625 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 20:48:40.164798 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Registered counter for database nova_api Jul 11 20:48:40.165138 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO dbcounter [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Registered counter for database nova_api Jul 11 20:48:40.283560 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG oslo_db.sqlalchemy.engines [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:48:40.285680 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:48:40.290530 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writer thread running {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:48:40.292998 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:48:40.345777 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.context [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e1024e7-6872-42da-8de2-23153914318d(cell1) {{(pid=103306) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 20:48:40.347718 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.context [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e1024e7-6872-42da-8de2-23153914318d(cell1) {{(pid=103305) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 20:48:40.349684 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG oslo_concurrency.lockutils [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:48:40.351247 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG oslo_concurrency.lockutils [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:48:40.351895 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:48:40.352031 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG oslo_concurrency.lockutils [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:48:40.353525 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:48:40.354107 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG oslo_concurrency.lockutils [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:48:40.354254 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:48:40.356054 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO dbcounter [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Registered counter for database nova_cell0 Jul 11 20:48:40.356375 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:48:40.358385 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Registered counter for database nova_cell0 Jul 11 20:48:40.359824 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO dbcounter [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Registered counter for database nova_cell1 Jul 11 20:48:40.362162 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Registered counter for database nova_cell1 Jul 11 20:48:40.367503 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG oslo_db.sqlalchemy.engines [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:48:40.370196 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG oslo_db.sqlalchemy.engines [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:48:40.371373 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:48:40.374577 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writer thread running {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:48:40.375337 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:48:40.376910 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:48:40.377632 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writer thread running {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:48:40.516663 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:48:40.524260 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO dbcounter [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Registered counter for database nova_cell0 Jul 11 20:48:40.526073 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Registered counter for database nova_cell0 Jul 11 20:48:40.535956 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG oslo_db.sqlalchemy.engines [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:48:40.537232 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:48:40.541051 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writer thread running {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:48:40.541695 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:48:40.872702 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: WARNING keystonemiddleware.auth_token [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 20:48:40.874750 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 20:48:40.880130 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: WARNING keystonemiddleware.auth_token [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 20:48:40.882044 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 20:48:41.220536 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: WARNING keystonemiddleware.auth_token [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 20:48:41.222465 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 20:48:41.226685 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: WARNING keystonemiddleware.auth_token [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 20:48:41.228658 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 20:48:41.231879 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56258cef39c0 pid: 103306 (default app) Jul 11 20:48:41.233880 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56258cef39c0 pid: 103305 (default app) Jul 11 20:48:41.234033 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:48:41.235146 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-3945e442-aff1-4622-9128-c6f1af66f45a None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Jul 11 20:48:41.235525 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Jul 11 20:48:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:49:57.188166 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:49:57.189546 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002210 Jul 11 20:49:57.189958 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:49:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:49:57.202192 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_api:SELECT=3 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:57.203556 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_cell0:SELECT=3 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:57.204565 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_cell1:SELECT=3 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:57.205289 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:58.051769 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-0b7fe6c8-4af2-461d-bcbb-cec4aea50b65 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:49:58.082976 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-0b7fe6c8-4af2-461d-bcbb-cec4aea50b65 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.886207 Jul 11 20:49:58.084158 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jul 11 20:49:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:50:00.309268 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:00.311246 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-b9c33e58-4c08-4ec4-af0c-6b16dc03c4c1 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002382 Jul 11 20:50:00.311637 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:00.795477 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-2db399a3-a333-4d13-9ac8-3737b5341b9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "cirros256"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:00.813623 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:50:00.813623 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: warnings.warn(msg) Jul 11 20:50:00.847440 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-2db399a3-a333-4d13-9ac8-3737b5341b9b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528976 Jul 11 20:50:00.848072 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 20:50:00.862632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=3 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:50:00.863858 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell0:SELECT=3 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:50:00.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell1:SELECT=3 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:50:00.865440 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:50:01.072147 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-9eb76cc1-8b62-44dd-833c-07b7b7e59ea1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:01.074864 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:50:01.074864 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 11 20:50:01.161871 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-9eb76cc1-8b62-44dd-833c-07b7b7e59ea1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.305062 Jul 11 20:50:01.174890 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jul 11 20:50:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:50:03.415288 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-2db399a3-a333-4d13-9ac8-3737b5341b9b admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:03.416408 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-2db399a3-a333-4d13-9ac8-3737b5341b9b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Jul 11 20:50:03.416907 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:04.092831 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-a5ce72e4-23c6-4bf2-a797-c3bbdbaf9a60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:04.112194 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:50:04.112194 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 11 20:50:04.131215 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-a5ce72e4-23c6-4bf2-a797-c3bbdbaf9a60 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.707358 Jul 11 20:50:04.131983 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:04.144285 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-818204be-e312-47ef-be0e-b84b46f78c73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:04.145807 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:50:04.145807 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: warnings.warn(msg) Jul 11 20:50:04.182257 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-818204be-e312-47ef-be0e-b84b46f78c73 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041692 Jul 11 20:50:04.182848 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jul 11 20:50:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:50:06.462323 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-a5ce72e4-23c6-4bf2-a797-c3bbdbaf9a60 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:06.463338 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-a5ce72e4-23c6-4bf2-a797-c3bbdbaf9a60 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 11 20:50:06.463733 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:06.889562 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-8d64d360-1eeb-4de3-9fb5-339d37317053 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:06.908810 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-8d64d360-1eeb-4de3-9fb5-339d37317053 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439068 Jul 11 20:50:06.909306 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:06.921571 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-50b681b7-adf3-4696-b545-6ff373a6ce72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:06.945679 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-50b681b7-adf3-4696-b545-6ff373a6ce72 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027892 Jul 11 20:50:06.946235 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jul 11 20:50:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:50:09.177271 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-8d64d360-1eeb-4de3-9fb5-339d37317053 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:09.178283 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-8d64d360-1eeb-4de3-9fb5-339d37317053 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 11 20:50:09.178695 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:09.650397 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-b8e1516b-cf9f-440c-b99a-96e09d7fddb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:09.670048 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-b8e1516b-cf9f-440c-b99a-96e09d7fddb0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485613 Jul 11 20:50:09.670627 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:09.683592 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-5b46f169-854a-470d-aafc-cdee2e099ce1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:09.708012 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-5b46f169-854a-470d-aafc-cdee2e099ce1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029107 Jul 11 20:50:09.708794 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jul 11 20:50:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:50:11.943678 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-b8e1516b-cf9f-440c-b99a-96e09d7fddb0 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:11.945843 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-b8e1516b-cf9f-440c-b99a-96e09d7fddb0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002425 Jul 11 20:50:11.946958 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:11 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:12.378163 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-bd5d9c7d-eda3-43a4-a93f-6cd33aa7bbe9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:12.403531 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-bd5d9c7d-eda3-43a4-a93f-6cd33aa7bbe9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450393 Jul 11 20:50:12.412379 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:12.419410 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-cae73d30-1788-4fd1-855e-922a93163060 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:12.452444 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-cae73d30-1788-4fd1-855e-922a93163060 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038654 Jul 11 20:50:12.453077 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jul 11 20:50:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:50:14.986882 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-bd5d9c7d-eda3-43a4-a93f-6cd33aa7bbe9 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:14.988001 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-bd5d9c7d-eda3-43a4-a93f-6cd33aa7bbe9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001778 Jul 11 20:50:14.988584 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:15.452671 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-1fc06486-b108-4c09-9d6e-c07f74eb74de admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:15.484787 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-1fc06486-b108-4c09-9d6e-c07f74eb74de admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.489099 Jul 11 20:50:15.485660 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jul 11 20:50:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:50:17.828369 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-bd5d9c7d-eda3-43a4-a93f-6cd33aa7bbe9 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:17.829485 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-bd5d9c7d-eda3-43a4-a93f-6cd33aa7bbe9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Jul 11 20:50:17.829893 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:18.305547 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-481933bf-5a05-45fe-8d6b-190a1256e0fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "name": "m1.tiny"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:18.326574 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-481933bf-5a05-45fe-8d6b-190a1256e0fd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.489594 Jul 11 20:50:18.327148 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:18.340392 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-7c527133-dd9f-49b8-9d86-a206ed18a690 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:18.367302 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-7c527133-dd9f-49b8-9d86-a206ed18a690 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030871 Jul 11 20:50:18.367910 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jul 11 20:50:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:50:20.639607 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-481933bf-5a05-45fe-8d6b-190a1256e0fd admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:20.640684 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-481933bf-5a05-45fe-8d6b-190a1256e0fd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 11 20:50:20.641089 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:21.051714 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-e160128d-4d7c-4685-9459-bbac38afc0af admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:21.070786 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-e160128d-4d7c-4685-9459-bbac38afc0af admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423815 Jul 11 20:50:21.071355 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:21.083555 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-09552343-ea01-477c-a319-57891d82ff13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:21.109372 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-09552343-ea01-477c-a319-57891d82ff13 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029676 Jul 11 20:50:21.109951 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jul 11 20:50:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:50:23.327031 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-e160128d-4d7c-4685-9459-bbac38afc0af admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:23.328051 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-e160128d-4d7c-4685-9459-bbac38afc0af admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 11 20:50:23.328661 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:23.727373 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-946f7d7e-1526-4a86-8af6-50f98c7c028b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:23.746380 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-946f7d7e-1526-4a86-8af6-50f98c7c028b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.411619 Jul 11 20:50:23.746925 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:23.759275 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-276a4f28-a57d-421a-9e4f-8e94888f3661 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:23.788179 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-276a4f28-a57d-421a-9e4f-8e94888f3661 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032766 Jul 11 20:50:23.789661 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jul 11 20:50:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:50:26.069299 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-946f7d7e-1526-4a86-8af6-50f98c7c028b admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:26.070942 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-946f7d7e-1526-4a86-8af6-50f98c7c028b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Jul 11 20:50:26.071560 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:26.506941 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-e698f446-c687-41dc-b7b4-3bba917f1070 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "rxtx_factor": 1.0}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:26.527346 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-e698f446-c687-41dc-b7b4-3bba917f1070 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.449454 Jul 11 20:50:26.528007 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:26.540266 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-7a8ccb47-8f15-4108-b7ca-a2fe924d40d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:26.570702 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-7a8ccb47-8f15-4108-b7ca-a2fe924d40d3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034298 Jul 11 20:50:26.571285 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jul 11 20:50:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:50:28.826227 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-e698f446-c687-41dc-b7b4-3bba917f1070 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:28.827247 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-e698f446-c687-41dc-b7b4-3bba917f1070 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 11 20:50:28.834216 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:28 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:29.269850 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-0a55e51b-7ab0-43a8-bff8-c94a7546d65f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "vcpus": 8}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:29.292832 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-0a55e51b-7ab0-43a8-bff8-c94a7546d65f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459416 Jul 11 20:50:29.293379 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jul 11 20:50:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 20:50:29.305785 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-a43bbd1e-24d3-493e-a7bf-471388c6d771 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:29.312784 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:50:29.334099 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-a43bbd1e-24d3-493e-a7bf-471388c6d771 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032391 Jul 11 20:50:29.334698 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jul 11 20:50:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:50:48.505338 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-0a55e51b-7ab0-43a8-bff8-c94a7546d65f admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:48.506355 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-0a55e51b-7ab0-43a8-bff8-c94a7546d65f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 11 20:50:48.506740 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:48.945716 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-21589eb1-3d5b-4f28-ad29-f366c138eb00 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:48.964989 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-21589eb1-3d5b-4f28-ad29-f366c138eb00 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.451480 Jul 11 20:50:48.965498 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jul 11 20:50:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:50:50.035463 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-0a55e51b-7ab0-43a8-bff8-c94a7546d65f admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:50.036497 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-0a55e51b-7ab0-43a8-bff8-c94a7546d65f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 11 20:50:50.036898 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:50:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:50.622475 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-db145abc-5d01-44e9-bc04-bf7981b87b30 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:50.628247 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.wsgi [None req-db145abc-5d01-44e9-bc04-bf7981b87b30 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-db145abc-5d01-44e9-bc04-bf7981b87b30 admin admin] Request method failure captured: Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Accept: application/json Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Accept-Encoding: gzip, deflate Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Connection: keep-alive Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Content-Length: 0 Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Host: 10.222.0.20 Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Openstack-Api-Version: compute 2.90 Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Openstack-System-Scope: None Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: User-Agent: python-novaclient Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Auth-Token: gAAAAABizI0p8tUyvEYN_xbpZIyFxBfW_RLijzPUT8Y951m27S2P8z2GQJXSoHmHLSmIsDfRn70dM1gcZ9tbjEAgdkk4E9XfSKaK8NoDzouukEG0oRxhRHUiBX3BEUhmTraYT0AZz1-ibe97V9EZ_CqW0m87qUENY1tfPsHZ3PusQdjMbsLZqds Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Domain-Id: None Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Domain-Name: None Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Identity-Status: Confirmed Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Is-Admin-Project: True Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Domain-Id: default Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Domain-Name: Default Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Name: admin Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Role: member,admin,reader Jul 11 20:50:50.631589 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Roles: member,admin,reader Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27db080494394cc5b886636221f8edb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27db080494394cc5b886636221f8edb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Tenant: admin Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Tenant-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Tenant-Name: admin Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User: admin Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Domain-Id: default Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Domain-Name: Default Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Id: 5fc8fd4688454d8c8596f77d99812999 Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Name: admin Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: method: > Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: exception: Flavor 42 could not be found. Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: action_args: {'id': '42'} Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:50:50.633068 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:50.634019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.635237 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-db145abc-5d01-44e9-bc04-bf7981b87b30 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:50:50.636486 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-db145abc-5d01-44e9-bc04-bf7981b87b30 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.451400 Jul 11 20:50:50.636486 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jul 11 20:50:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 11 20:50:50.645731 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-3e5adb51-4b6b-4f18-9f4d-473869b97059 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:50.649957 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:50:50.669483 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-3e5adb51-4b6b-4f18-9f4d-473869b97059 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029705 Jul 11 20:50:50.670048 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jul 11 20:50:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:50:50.680131 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-4728a47a-829f-46eb-b465-6c102210c33b admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:50.702204 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-4728a47a-829f-46eb-b465-6c102210c33b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025859 Jul 11 20:50:50.702719 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jul 11 20:50:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:50:50.714548 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-4f7ecdd0-1ef0-4be0-832c-bef19bf72b88 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:50.721128 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.wsgi [None req-4f7ecdd0-1ef0-4be0-832c-bef19bf72b88 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-4f7ecdd0-1ef0-4be0-832c-bef19bf72b88 admin admin] Request method failure captured: Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Accept: application/json Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Accept-Encoding: gzip, deflate Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Connection: keep-alive Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Content-Length: 0 Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Host: 10.222.0.20 Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Openstack-Api-Version: compute 2.90 Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Openstack-System-Scope: None Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: User-Agent: python-novaclient Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Auth-Token: gAAAAABizI0p8tUyvEYN_xbpZIyFxBfW_RLijzPUT8Y951m27S2P8z2GQJXSoHmHLSmIsDfRn70dM1gcZ9tbjEAgdkk4E9XfSKaK8NoDzouukEG0oRxhRHUiBX3BEUhmTraYT0AZz1-ibe97V9EZ_CqW0m87qUENY1tfPsHZ3PusQdjMbsLZqds Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Domain-Id: None Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Domain-Name: None Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Identity-Status: Confirmed Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Is-Admin-Project: True Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Id: default Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Name: Default Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Name: admin Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Role: member,admin,reader Jul 11 20:50:50.724467 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Roles: member,admin,reader Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27db080494394cc5b886636221f8edb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27db080494394cc5b886636221f8edb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Tenant: admin Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Tenant-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Tenant-Name: admin Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User: admin Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Id: default Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Name: Default Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Id: 5fc8fd4688454d8c8596f77d99812999 Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Name: admin Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: method: > Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: exception: Flavor 42 could not be found. Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: action_args: {'id': '42'} Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:50:50.725853 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:50.726632 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:50.727863 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-4f7ecdd0-1ef0-4be0-832c-bef19bf72b88 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:50:50.729019 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-4f7ecdd0-1ef0-4be0-832c-bef19bf72b88 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015345 Jul 11 20:50:50.729019 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jul 11 20:50:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 20:50:51.720791 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-4728a47a-829f-46eb-b465-6c102210c33b admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:51.721807 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-4728a47a-829f-46eb-b465-6c102210c33b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 11 20:50:51.722195 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:50:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:52.292994 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-b85d7a33-98dd-488a-9025-be45c36fde46 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:52.300679 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.wsgi [None req-b85d7a33-98dd-488a-9025-be45c36fde46 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-b85d7a33-98dd-488a-9025-be45c36fde46 admin admin] Request method failure captured: Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Accept: application/json Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Accept-Encoding: gzip, deflate Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Connection: keep-alive Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Content-Length: 0 Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Host: 10.222.0.20 Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Openstack-Api-Version: compute 2.90 Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Openstack-System-Scope: None Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: User-Agent: python-novaclient Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Auth-Token: gAAAAABizI0rz2C5ngfi_FLEm3WOTaknxFAq7okS7SzhzG5oPuQd8kota0zyUogOWm-Sf3P5yrSE9CxE6f1glK-HrZwDRmBFe3oOdOhI-dhiXB2BFdQ_UE6bsQeQNSn7tRZjsbRzg2rXURi0lI3-zp4-rZp02inCTgnSX8kgdwIbmwIFvwDDdGY Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Domain-Id: None Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Domain-Name: None Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Identity-Status: Confirmed Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Is-Admin-Project: True Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Id: default Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Name: Default Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Name: admin Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Role: member,admin,reader Jul 11 20:50:52.302993 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Roles: member,admin,reader Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27db080494394cc5b886636221f8edb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27db080494394cc5b886636221f8edb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Tenant: admin Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Tenant-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Tenant-Name: admin Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User: admin Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Id: default Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Name: Default Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Id: 5fc8fd4688454d8c8596f77d99812999 Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Name: admin Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: method: > Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: exception: Flavor 84 could not be found. Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: action_args: {'id': '84'} Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:50:52.304455 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:52.305466 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.306633 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-b85d7a33-98dd-488a-9025-be45c36fde46 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:50:52.307658 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-b85d7a33-98dd-488a-9025-be45c36fde46 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.444444 Jul 11 20:50:52.307658 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jul 11 20:50:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 20:50:52.315358 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-9b081d9f-6694-48a5-9298-eb525e0f29f8 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:52.329206 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-9b081d9f-6694-48a5-9298-eb525e0f29f8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017850 Jul 11 20:50:52.329729 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jul 11 20:50:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:50:52.339200 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-e7b6fa05-c990-4519-ad76-a3a153defff0 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:52.353211 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-e7b6fa05-c990-4519-ad76-a3a153defff0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017637 Jul 11 20:50:52.353727 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jul 11 20:50:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:50:52.363040 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-85534c04-1cfe-4ddc-9919-ec7b3d1a59e1 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:52.369181 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.wsgi [None req-85534c04-1cfe-4ddc-9919-ec7b3d1a59e1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-85534c04-1cfe-4ddc-9919-ec7b3d1a59e1 admin admin] Request method failure captured: Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Accept: application/json Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Accept-Encoding: gzip, deflate Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Connection: keep-alive Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Content-Length: 0 Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Host: 10.222.0.20 Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Openstack-Api-Version: compute 2.90 Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Openstack-System-Scope: None Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: User-Agent: python-novaclient Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Auth-Token: gAAAAABizI0rz2C5ngfi_FLEm3WOTaknxFAq7okS7SzhzG5oPuQd8kota0zyUogOWm-Sf3P5yrSE9CxE6f1glK-HrZwDRmBFe3oOdOhI-dhiXB2BFdQ_UE6bsQeQNSn7tRZjsbRzg2rXURi0lI3-zp4-rZp02inCTgnSX8kgdwIbmwIFvwDDdGY Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Domain-Id: None Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Domain-Name: None Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Identity-Status: Confirmed Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Is-Admin-Project: True Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Domain-Id: default Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Domain-Name: Default Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Name: admin Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Role: member,admin,reader Jul 11 20:50:52.370722 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Roles: member,admin,reader Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27db080494394cc5b886636221f8edb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27db080494394cc5b886636221f8edb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Tenant: admin Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Tenant-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Tenant-Name: admin Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User: admin Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Domain-Id: default Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Domain-Name: Default Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Id: 5fc8fd4688454d8c8596f77d99812999 Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Name: admin Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: method: > Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: exception: Flavor 84 could not be found. Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: action_args: {'id': '84'} Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:50:52.372282 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:52.373148 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:52.374329 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-85534c04-1cfe-4ddc-9919-ec7b3d1a59e1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:50:52.375632 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-85534c04-1cfe-4ddc-9919-ec7b3d1a59e1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012588 Jul 11 20:50:52.375632 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jul 11 20:50:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 20:50:53.350001 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-e7b6fa05-c990-4519-ad76-a3a153defff0 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:53.351083 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-e7b6fa05-c990-4519-ad76-a3a153defff0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 11 20:50:53.351490 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:50:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:53.908174 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-139543c0-e4e8-4c3b-abd1-3f340b378186 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:53.914340 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.wsgi [None req-139543c0-e4e8-4c3b-abd1-3f340b378186 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-139543c0-e4e8-4c3b-abd1-3f340b378186 admin admin] Request method failure captured: Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Accept: application/json Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Accept-Encoding: gzip, deflate Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Connection: keep-alive Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Content-Length: 0 Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Host: 10.222.0.20 Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Openstack-Api-Version: compute 2.90 Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Openstack-System-Scope: None Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: User-Agent: python-novaclient Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Auth-Token: gAAAAABizI0tIK3eJXapXrewpNSl4vZ5EGMQ9Ft3BaaYICgAYAyyERAxOJYNft_2ZN9YhUAdH6FLhUflZVBZIcKuzem1X16y0ZAHPRHEuyV8k1UZrptIFPU8_Z0XkgQrx32iIbMfcMUR2vYsrycFBEsAPdAX-chMJ279rmc8Y-SADjSF-HCRzDk Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Domain-Id: None Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Domain-Name: None Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Identity-Status: Confirmed Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Is-Admin-Project: True Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Domain-Id: default Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Domain-Name: Default Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Project-Name: admin Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Role: member,admin,reader Jul 11 20:50:53.915837 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Roles: member,admin,reader Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27db080494394cc5b886636221f8edb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27db080494394cc5b886636221f8edb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Tenant: admin Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Tenant-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-Tenant-Name: admin Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User: admin Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Domain-Id: default Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Domain-Name: Default Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Id: 5fc8fd4688454d8c8596f77d99812999 Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: X-User-Name: admin Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: method: > Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: exception: Flavor 451 could not be found. Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: action_args: {'id': '451'} Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:50:53.917187 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:53.917944 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.919027 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-139543c0-e4e8-4c3b-abd1-3f340b378186 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:50:53.920086 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-139543c0-e4e8-4c3b-abd1-3f340b378186 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.427893 Jul 11 20:50:53.920086 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jul 11 20:50:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 20:50:53.927250 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-85ba795f-47fc-4b5c-bb7e-6fc2b93de344 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:53.941730 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-85ba795f-47fc-4b5c-bb7e-6fc2b93de344 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018133 Jul 11 20:50:53.942266 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jul 11 20:50:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:50:53.952034 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:53.967117 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018740 Jul 11 20:50:53.967637 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jul 11 20:50:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:50:53.977141 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-6155a5ea-ae71-414e-9811-7b825655888d admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:53.982895 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.wsgi [None req-6155a5ea-ae71-414e-9811-7b825655888d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-6155a5ea-ae71-414e-9811-7b825655888d admin admin] Request method failure captured: Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Accept: application/json Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Accept-Encoding: gzip, deflate Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Connection: keep-alive Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Content-Length: 0 Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Host: 10.222.0.20 Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Openstack-Api-Version: compute 2.90 Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Openstack-System-Scope: None Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: User-Agent: python-novaclient Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Auth-Token: gAAAAABizI0tIK3eJXapXrewpNSl4vZ5EGMQ9Ft3BaaYICgAYAyyERAxOJYNft_2ZN9YhUAdH6FLhUflZVBZIcKuzem1X16y0ZAHPRHEuyV8k1UZrptIFPU8_Z0XkgQrx32iIbMfcMUR2vYsrycFBEsAPdAX-chMJ279rmc8Y-SADjSF-HCRzDk Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Domain-Id: None Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Domain-Name: None Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Identity-Status: Confirmed Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Is-Admin-Project: True Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Id: default Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Name: Default Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Project-Name: admin Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Role: member,admin,reader Jul 11 20:50:53.984431 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Roles: member,admin,reader Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27db080494394cc5b886636221f8edb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27db080494394cc5b886636221f8edb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27db080494394cc5b886636221f8edb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Tenant: admin Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Tenant-Id: 27db080494394cc5b886636221f8edb9 Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-Tenant-Name: admin Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User: admin Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Id: default Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Name: Default Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Id: 5fc8fd4688454d8c8596f77d99812999 Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: X-User-Name: admin Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: method: > Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: exception: Flavor 451 could not be found. Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: action_args: {'id': '451'} Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:50:53.986029 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:53.986945 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 11 20:50:53.988042 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-6155a5ea-ae71-414e-9811-7b825655888d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:50:53.989115 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-6155a5ea-ae71-414e-9811-7b825655888d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012391 Jul 11 20:50:53.989115 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jul 11 20:50:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 20:50:54.968527 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:54.969832 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001986 Jul 11 20:50:54.970306 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:50:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:55.528278 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-2b3a664f-164f-4112-8607-aa080ff085e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:55.556730 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-2b3a664f-164f-4112-8607-aa080ff085e6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.450322 Jul 11 20:50:55.557831 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jul 11 20:50:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:56.546297 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:56.547310 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 11 20:50:56.547696 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:50:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:57.106173 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f62af2e4-7dfc-42e4-9133-dbe396c83ed0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:57.126606 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-f62af2e4-7dfc-42e4-9133-dbe396c83ed0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.441111 Jul 11 20:50:57.127141 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jul 11 20:50:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:58.112645 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:58.113650 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 11 20:50:58.114019 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:50:58.685379 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f47b94ec-2c49-4da1-805f-ce472ed82fb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:50:58.709350 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-f47b94ec-2c49-4da1-805f-ce472ed82fb8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.460262 Jul 11 20:50:58.709902 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jul 11 20:50:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:50:59.700232 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:50:59.701273 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 11 20:50:59.701676 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:50:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:51:00.248187 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-51353102-1646-4f90-a2c0-7f3e7fb7b351 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:51:00.273825 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-51353102-1646-4f90-a2c0-7f3e7fb7b351 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.433035 Jul 11 20:51:00.274646 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jul 11 20:50:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:51:01.315926 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:51:01.317487 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002570 Jul 11 20:51:01.318034 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:51:01.893937 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-2719bd71-42c5-43b6-8132-e4b731ee54d9 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:51:01.913636 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-2719bd71-42c5-43b6-8132-e4b731ee54d9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.446258 Jul 11 20:51:01.914167 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Jul 11 20:51:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:51:54.476766 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:51:54.478003 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-0e94667b-3649-4cc5-920c-9022d0cd3f3f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001978 Jul 11 20:51:54.478455 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jul 11 20:51:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:51:54.488905 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:54.893802 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-884a18ff-95c5-4e30-bb69-33b1bd8dcf48 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:51:54.913809 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-884a18ff-95c5-4e30-bb69-33b1bd8dcf48 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.429415 Jul 11 20:51:54.914319 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jul 11 20:51:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:51:54.934894 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:54.939119 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-44285cfa-bc95-495d-82e9-b2cc8a0b6b23 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:51:54.947549 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-44285cfa-bc95-495d-82e9-b2cc8a0b6b23 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013981 Jul 11 20:51:54.948079 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Jul 11 20:51:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:51:54.959801 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-60ab440b-5af8-4712-ad38-f96f85673ed6 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:51:54.967868 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-60ab440b-5af8-4712-ad38-f96f85673ed6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011652 Jul 11 20:51:54.968408 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Jul 11 20:51:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:51:54.980045 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:51:54.987825 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011718 Jul 11 20:51:54.988387 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Jul 11 20:51:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:51:55.000012 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-d2ab7c25-9252-43b4-87e9-4128be8a4a25 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:51:55.007508 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-d2ab7c25-9252-43b4-87e9-4128be8a4a25 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011037 Jul 11 20:51:55.008002 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Jul 11 20:51:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:55:19.419289 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:55:19.420345 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 11 20:55:19.420740 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:55:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:55:19.566623 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=6 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:55:19.747721 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-1ba02f3c-7158-4afc-ab17-e63d649c5011 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:55:19.748930 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:55:19.748930 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 11 20:55:19.750141 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-1ba02f3c-7158-4afc-ab17-e63d649c5011 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:55:19.750581 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-1ba02f3c-7158-4afc-ab17-e63d649c5011 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:55:19.751365 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-1ba02f3c-7158-4afc-ab17-e63d649c5011 admin admin] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:55:19.751792 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-1ba02f3c-7158-4afc-ab17-e63d649c5011 admin admin] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:55:19.786934 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-1ba02f3c-7158-4afc-ab17-e63d649c5011 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.228579 Jul 11 20:55:19.787488 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jul 11 20:55:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:55:20.619309 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:55:20.620947 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002395 Jul 11 20:55:20.621524 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:55:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:55:20.818914 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-10c48b2e-e947-4d1d-a103-a49300bdabf0 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:55:20.820133 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:55:20.820133 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 11 20:55:20.821454 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-10c48b2e-e947-4d1d-a103-a49300bdabf0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:55:20.821821 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-10c48b2e-e947-4d1d-a103-a49300bdabf0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:55:20.822589 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-10c48b2e-e947-4d1d-a103-a49300bdabf0 admin admin] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:55:20.823010 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-10c48b2e-e947-4d1d-a103-a49300bdabf0 admin admin] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:55:20.842722 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-10c48b2e-e947-4d1d-a103-a49300bdabf0 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084656 Jul 11 20:55:20.843278 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jul 11 20:55:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 20:55:32.134633 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:55:32.136002 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Jul 11 20:55:32.136644 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:55:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:55:32.288938 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell0:SELECT=4 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:55:32.289636 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell1:SELECT=4 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:55:32.290283 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=8 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:55:32.350711 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-67ee280c-e85e-4872-ae6a-22989b9d2a37 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:55:32.351929 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:55:32.351929 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 11 20:55:32.353181 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-67ee280c-e85e-4872-ae6a-22989b9d2a37 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:55:32.353677 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-67ee280c-e85e-4872-ae6a-22989b9d2a37 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:55:32.354456 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-67ee280c-e85e-4872-ae6a-22989b9d2a37 admin admin] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:55:32.354883 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-67ee280c-e85e-4872-ae6a-22989b9d2a37 admin admin] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:55:32.379797 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-67ee280c-e85e-4872-ae6a-22989b9d2a37 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.097188 Jul 11 20:55:32.380428 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 37/74] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jul 11 20:55:32 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:55:33.215703 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:55:33.216776 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-3f632cec-7b52-4b52-a16a-d97f7132de91 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jul 11 20:55:33.217166 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jul 11 20:55:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:55:33.408514 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-8b8c9ff7-f6ea-48e0-ae1e-b306212deaeb admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:55:33.409705 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:55:33.409705 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 11 20:55:33.410918 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-8b8c9ff7-f6ea-48e0-ae1e-b306212deaeb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:55:33.411360 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-8b8c9ff7-f6ea-48e0-ae1e-b306212deaeb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:55:33.412693 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-8b8c9ff7-f6ea-48e0-ae1e-b306212deaeb admin admin] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:55:33.413125 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-8b8c9ff7-f6ea-48e0-ae1e-b306212deaeb admin admin] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:55:33.435682 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-8b8c9ff7-f6ea-48e0-ae1e-b306212deaeb admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082251 Jul 11 20:55:33.436176 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jul 11 20:55:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:56:30.103697 dv-cinder-849022-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 11 20:56:30.104244 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: Mon Jul 11 20:56:30 2022 - graceful shutdown triggered... Jul 11 20:56:30.104687 dv-cinder-849022-2-iscsi devstack@n-api.service[103306]: Gracefully killing worker 2 (pid: 103306)... Jul 11 20:56:30.105034 dv-cinder-849022-2-iscsi devstack@n-api.service[103305]: Gracefully killing worker 1 (pid: 103305)... Jul 11 20:56:31.104415 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: worker 1 buried after 1 seconds Jul 11 20:56:31.104415 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: worker 2 buried after 1 seconds Jul 11 20:56:31.104415 dv-cinder-849022-2-iscsi devstack@n-api.service[103304]: goodbye to uWSGI. Jul 11 20:56:31.106834 dv-cinder-849022-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 11 20:56:31.107716 dv-cinder-849022-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 11 20:56:31.112259 dv-cinder-849022-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 20:56:31.128434 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 20:56:31 2022] *** Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: nodename: dv-cinder-849022-2-iscsi Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: machine: x86_64 Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: clock source: unix Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: pcre jit disabled Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: detected number of CPU cores: 4 Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: current working directory: / Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: detected binary path: /usr/bin/uwsgi-core Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: your processes number limit is 47680 Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: your memory page size is 4096 bytes Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: detected max file descriptor number: 2048 Jul 11 20:56:31.130633 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: lock engine: pthread robust mutexes Jul 11 20:56:31.131541 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: thunder lock: enabled Jul 11 20:56:31.131541 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 20:56:31.131541 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 20:56:31.185168 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: Python main interpreter initialized at 0x55bca05d29c0 Jul 11 20:56:31.185168 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: python threads support enabled Jul 11 20:56:31.185168 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: your server socket listen backlog is limited to 100 connections Jul 11 20:56:31.185168 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: your mercy for graceful operations on workers is 90 seconds Jul 11 20:56:31.185638 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 20:56:31.185638 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: *** Operational MODE: preforking *** Jul 11 20:56:31.185897 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: *** uWSGI is running in multiple interpreter mode *** Jul 11 20:56:31.185897 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: spawned uWSGI master process (pid: 118001) Jul 11 20:56:31.186113 dv-cinder-849022-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 20:56:31.188437 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: spawned uWSGI worker 1 (pid: 118013, cores: 1) Jul 11 20:56:31.188437 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: spawned uWSGI worker 2 (pid: 118014, cores: 1) Jul 11 20:56:31.188437 dv-cinder-849022-2-iscsi devstack@n-api.service[118001]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 20:56:31.839812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 20:56:31.840317 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 20:56:33.029576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:56:33.029576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: from cryptography.utils import int_from_bytes Jul 11 20:56:33.030195 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:56:33.030195 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: from cryptography.utils import int_from_bytes Jul 11 20:56:33.056144 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:56:33.056144 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: from cryptography.utils import int_from_bytes Jul 11 20:56:33.056747 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:56:33.056747 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: from cryptography.utils import int_from_bytes Jul 11 20:56:35.336342 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 20:56:35.337006 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 20:56:35.337102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 20:56:35.337455 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 20:56:35.337710 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 20:56:35.338125 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.338451 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.338743 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.339088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.339420 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.339731 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.340018 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.340394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.340722 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.340964 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.341297 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.341621 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849022-2-iscsi {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.341937 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.342228 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.342534 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.342839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.343146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.343485 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.343786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.344380 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.345762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.345762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.345762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.346041 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.346415 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.346656 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.346981 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.347308 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.347608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.347919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.348357 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849022-2-iscsi {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.348680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.348984 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.349297 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.349714 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.350048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.350339 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.350659 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.350978 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.351287 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.351613 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.351930 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.352293 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.352587 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.352910 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.353206 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.353506 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.353840 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.354139 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.354431 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.354685 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.354979 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.355298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.355616 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.355937 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.356224 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.356475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.356787 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.357110 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.357401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.357750 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.358018 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.358326 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.358641 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.358945 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.359244 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.359550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.359848 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.360200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.360519 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.360825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.361179 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.361674 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 20:56:35.362155 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.362313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 20:56:35.362465 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.362465 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.362747 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 20:56:35.362917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.363063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 20:56:35.363215 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.363383 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 20:56:35.363543 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.363697 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.363872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.364028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.364225 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.364370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.364517 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.364665 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.364833 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.364983 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.365132 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.365273 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.365419 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.365579 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.365780 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.365934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.366075 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.366228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.366380 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.366532 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.366674 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.366836 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.366988 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.367140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849022-2-iscsi {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.367288 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.367460 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.367621 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.367771 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.367918 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.368086 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.368281 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.368430 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.368596 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.368746 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.368899 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.369050 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.369213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.369805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.369966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.369966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.370266 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.370446 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.370596 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.370748 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.370908 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.371208 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.371385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.371543 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.372246 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.372411 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.372564 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.372713 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.372855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.373010 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.373164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.373312 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.373463 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.373611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.373771 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.373926 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.374068 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.374220 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.374377 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849022-2-iscsi {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.374520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.374671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.374812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.374952 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.375102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.375244 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.375391 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.375391 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.375716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.375885 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.376035 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.376217 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.376369 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.376518 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.376668 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.376820 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.376962 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.377102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.377249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.377390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.377556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.377713 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.377862 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.378011 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.378152 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.378294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.378441 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.378592 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.378747 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.378943 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.379088 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.379088 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.379372 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.380015 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.380192 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.380354 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.380496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.380645 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.380800 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.380960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.381131 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.381429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.381584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.381734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.381890 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.382051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.382192 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.382342 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.382497 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.382647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.382647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.382930 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.383078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.383226 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.383375 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.383530 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.383678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.383836 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.383979 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.384169 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.384336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.384484 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.384636 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.384777 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.384924 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.385065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.385219 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.385368 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.385516 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.385665 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.385812 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.385960 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.386117 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.386258 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.386407 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.386553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.386701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.386840 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.387067 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.387211 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.387352 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.387498 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.387664 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.387818 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.387960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.388099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.388284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.388426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.388567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.388567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.388852 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.388992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.389131 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.389283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.389434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.389610 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.390244 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.390404 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.390547 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.390696 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.390837 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.390992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.391134 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.391283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.391591 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.391755 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.391898 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.392064 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.392265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.392420 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.392607 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.392757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.392908 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.393098 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.393273 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.393417 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.393558 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.393709 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.393868 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.394010 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.394169 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.394311 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.394311 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.394588 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.394739 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.394887 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.394887 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.395187 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.395467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.395628 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.395788 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.395930 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.396096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.396929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.397081 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.397234 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.397376 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.397523 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.397683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.397833 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.397833 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.398122 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.398273 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.398421 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.398562 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.398711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.398870 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.399022 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.399173 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.399320 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.399470 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.399612 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.399767 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.401020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.401176 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.401317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.401481 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.401820 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.401978 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.402134 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.402275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.402424 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.402576 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.402731 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.402884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.403031 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.403181 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.403330 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.403471 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.403627 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.403776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.403939 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.404097 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.404273 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.404432 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.404581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.404729 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.404876 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.405018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.405165 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.405316 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.405458 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.405606 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.405762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.405914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.406056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.406206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.406347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.406487 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.406635 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.406784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.406933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.407084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.407225 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.407371 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.407527 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.407670 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.407821 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.407979 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.408247 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.408429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.408572 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.408713 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.408863 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.409023 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.409174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.409324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.409473 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.409622 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:56:35.409777 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.409930 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.410079 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.410222 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.410362 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.410539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.411218 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.411363 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.411506 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.411654 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.411968 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.412166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.412326 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.412489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.412632 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.412773 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.412919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.413071 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.413212 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.413354 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.413507 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.413655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.413796 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.413953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.414101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.414243 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.414394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.414542 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.414693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.414845 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.414986 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.415127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.415274 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.415422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.415650 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.415804 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.415954 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.416136 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.416286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.416454 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.416608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.416756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.416902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.417042 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.417191 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.417339 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.417501 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.417652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.417800 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.417948 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.418699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.418865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.419022 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.419175 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.419317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.419466 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.419608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.419759 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.419900 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.420042 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.420216 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.420379 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.420529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.420706 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.421389 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.421533 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.421682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.421834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.422161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.422324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.422475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.422624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.422767 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.422915 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.423056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.423206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.423356 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.423516 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.423667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.423903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.424056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.424251 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.424405 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.424556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.424697 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.424838 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.424993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.425142 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.425283 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.425431 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.425583 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.425724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.425879 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.426023 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.426166 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.426314 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.426454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.426603 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.426757 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.426906 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.427049 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.427198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.427339 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.427509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.427660 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.427810 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.427950 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.428091 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.428275 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.428432 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.428580 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.428722 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.428870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.429018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.429167 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.429339 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.429482 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.429638 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.429787 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.429935 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.430084 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.430236 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.430377 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.430518 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.430518 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.430797 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.431480 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.431646 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.431810 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.431961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.431961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.431961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.431961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.432702 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.432846 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.432994 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.433135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.433284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.433798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.433942 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.434091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.434246 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.434400 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.434541 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.434691 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.434858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.435130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.435299 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.435444 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.435585 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.435735 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.435884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.436032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.436229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.436393 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.436550 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.436701 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.436843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.436985 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.437133 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.437273 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.437435 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.437652 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.437815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.437957 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.438105 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.438263 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.438414 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.438556 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.438696 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.438844 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.438993 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.439142 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.439320 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.439466 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.439608 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.439755 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.439903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.440052 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.440295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.440448 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.440605 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.440755 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.440897 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.441068 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.441698 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.441841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.441991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.442132 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.442432 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.442594 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.442738 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.442901 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.443043 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.443190 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.443340 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.443491 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.443639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.443789 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.443930 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.444078 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.444290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.444386 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.444508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.444634 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.444767 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.444903 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.445038 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.445171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.445297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.445428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.445560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.445693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.445828 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.445953 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.446084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.446215 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.446341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.446464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.446675 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.446802 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.446935 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.447067 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.447199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.447341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.447466 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.447589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.447722 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.447855 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.447989 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.448138 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.448138 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.448387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.448387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.448630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.448763 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.448909 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.449036 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.449160 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.449284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.449284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.449516 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.449649 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.449774 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.449897 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.450022 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.450145 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.450277 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.450411 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.450544 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.450681 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.450813 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.450947 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.451082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.451229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.451825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.451962 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.452087 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.452249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.452249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.452694 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.452822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.452822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.453080 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.453206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.453206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.453450 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.453582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.453582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.453834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.453960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.453960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.454202 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.454334 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.454480 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.454615 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.454615 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.454859 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.455208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.455208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.455772 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.456225 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.456225 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.456493 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.456630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.456630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.456875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.457001 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.457126 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.457250 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.457250 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.457496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.457645 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.457645 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.457997 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.458132 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.458265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.458406 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.458532 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.458658 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.458658 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.458899 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.459025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.459025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.459274 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.459398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.459523 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.459655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.459655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.459908 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.460034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.460034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.460353 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.460488 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.460625 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.460751 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.460751 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.460994 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.461119 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.461251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.461407 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.462032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.462167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.462167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.462403 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.462537 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.462537 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.462890 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.463103 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.463103 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.463343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.463482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.463608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.463734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.463734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.463984 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.464167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.464167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.464423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.464556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.464556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.465494 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.465634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.465826 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.465955 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.465955 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.466199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.466323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.466323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.466570 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.466697 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.466830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.466965 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.467091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.467226 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.467226 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.467471 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.467604 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.467736 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.467874 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.467874 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.468154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.468281 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.468281 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.468539 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.468690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.469430 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.469430 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.469681 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.469815 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.469950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.469950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.470202 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.470329 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.470329 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.470628 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.470920 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.471410 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.471566 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.471566 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.472352 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.472480 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.472480 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.472759 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.472919 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.473054 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.473287 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.473287 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.473539 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.473672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.473799 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.473934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.474074 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.474202 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.474202 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.474446 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.474571 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.474571 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.474825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.474950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.475082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.475209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.475209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.475529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.475739 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.475739 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.475978 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.476154 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.476304 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.476431 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.476571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.476706 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.476706 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.476959 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.477092 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.477092 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.477343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.477480 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.477617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.477743 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.477743 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.477993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.478127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.478127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.478368 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.478493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.478617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.478751 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.478751 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.479041 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.479167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.479300 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.479427 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.479427 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.479680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.479805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.479805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.480047 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.480212 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.480212 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.480467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.480603 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.480603 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.480856 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.480990 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.481115 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.481240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.481240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.481473 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.481598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.481598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.482417 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.482556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.482690 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.482825 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.482825 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.483073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.483200 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.483200 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.483538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.483674 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.483810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.483936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.484059 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.484246 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.484246 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.484503 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.484639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.484639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.484884 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.485017 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.485153 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.485279 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.485279 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.485552 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.485756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.485756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.486004 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.486166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.486393 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.486527 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.486527 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.486782 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.486916 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.486916 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.487163 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.487287 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.487287 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.487534 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.487658 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.487658 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.487918 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.488050 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.488204 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.488335 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.488466 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.488645 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.488774 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.489018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.489145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.489318 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.489569 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.489712 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.489905 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.490039 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.490203 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.490464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.490602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.490786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.490951 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.491088 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.491385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.491511 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.491694 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.491864 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.492557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.492694 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.492820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.492959 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.493102 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.493102 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.493347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.493566 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.493703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.493840 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.493980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.494679 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.494825 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.494961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.495096 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.495096 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.495343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.495493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.495839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.495965 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.495965 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.496198 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.496325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.496325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.496586 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.496721 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.496913 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.497048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.497220 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.497480 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.497625 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.497804 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.497964 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.498114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.498414 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.498568 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.498750 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.498884 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.499034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.499319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.499450 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.499624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.499809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.499951 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.500320 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.500501 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.500638 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.500779 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.500906 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.501133 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.501269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.501439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.501618 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.501831 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.502086 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.502971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.503108 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.503244 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.503390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.503519 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.503748 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.503899 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.503899 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.504251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.504398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.504525 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.504659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.504659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.504896 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.505030 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.505224 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.505357 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.505493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.505681 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.505811 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.506019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.506303 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.506452 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.506724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.506866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.507355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.507504 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.507632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.507767 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.507894 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.507894 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.508164 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.508310 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.508603 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.508731 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.508858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.508989 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.509198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.509394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.509533 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.509711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.509848 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.510082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.510216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.510378 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.510516 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.510679 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.510809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.510984 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.511123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.511303 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.511441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.511602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.511732 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.511909 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.512054 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.512297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.512799 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.513109 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.513241 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.513375 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.513579 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.513717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.513947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.513947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.514199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.514325 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.514461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.514588 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.514722 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.514848 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.514974 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.514974 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.515229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.515355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.515489 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.515616 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.515749 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.515885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.516036 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.516258 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.516396 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.516521 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.516645 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.516790 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.516916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.517053 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.517190 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.517326 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.517561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.517763 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.517902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.518078 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.518230 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.518407 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.518537 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.518737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.518873 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.519051 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.519180 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.519371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.519500 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.519680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.519818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.520007 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.520209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.520368 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.520497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.520682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.520811 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.521006 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.521145 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.521368 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.521505 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.521689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.521826 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.521988 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.522127 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.522294 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.522423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.522899 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.523055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.523328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.523478 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.523745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.523886 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.524136 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.524281 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.524420 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.524549 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.524683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.524811 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.524945 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.525080 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.525214 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.525350 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.525484 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.525612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.525738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.525864 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.525998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.526125 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.526264 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.526459 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.526598 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.526735 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.526875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.527003 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.527136 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.527262 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.527388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.527528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.527657 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.527784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.527784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.528023 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.528198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.528337 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.528473 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.528599 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.528727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.528852 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.528978 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.529113 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.529293 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.529424 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.529594 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.529733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.529912 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.530052 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.530240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.530371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.530550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.530678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.530855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.531027 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.531185 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.531324 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.531523 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.531660 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.531848 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.531982 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.532166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.532288 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.532486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.532602 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.533107 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.533402 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.533534 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.533645 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.533756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.533865 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.533989 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.534118 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.534322 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.534447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.534566 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.534754 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.535015 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.535154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.535268 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.535386 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.535496 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.535619 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.535730 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.535838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.535947 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.536057 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.536205 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.536333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.536469 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.536649 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.536773 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.536881 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.537037 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.537164 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.537339 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.537482 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.537639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.537762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.537980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.538113 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.538280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.538417 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.538588 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.538715 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.538910 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.539046 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.539224 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.539361 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.539549 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.539678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.539855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.539992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.540204 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.540341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.540519 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.540642 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.540831 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.540947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.541139 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.541264 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.541448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.541592 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.541772 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.541909 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.542094 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.542231 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.542375 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.542562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.542693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.542827 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.543308 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.543605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.543739 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.543880 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.544007 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.544196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.544196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.544578 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.544750 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.544901 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.545031 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.545157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.545157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.545401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.545539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.545675 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.545853 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.545994 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.546122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.546248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.546389 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.546526 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.546676 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.546873 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.547012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.547148 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.547286 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.547424 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.547552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.547678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.547804 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.547946 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.548082 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.548234 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.548363 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.548501 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.548779 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.548928 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.549097 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.549235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.549408 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.549538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.549720 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.549880 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.550074 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.550217 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.550386 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.550516 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.550690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.550822 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.551002 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.551140 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.551313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.551457 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.551622 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.551758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.551929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.552081 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.552265 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.552410 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.552576 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.552714 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.552885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.553030 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.553480 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.553781 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.553914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.554041 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.554175 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.554311 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.554428 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.554657 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.554798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.554926 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.555053 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.555178 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.555322 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.555449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.555575 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.555710 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.555839 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.555975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.556143 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.556271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.556271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.556512 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.556640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.556766 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.556913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.557110 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.557324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.557451 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.557641 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.557780 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.557956 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.558086 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.558270 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.558785 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.559004 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.559144 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.559272 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.559404 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.559538 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.559663 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.559803 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.559979 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.560145 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.560318 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.560449 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.560628 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.560759 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.560946 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.561077 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.561261 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.561399 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.561571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.561710 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.561881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.562010 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.562200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.562412 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.562542 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.562755 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.562886 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.563066 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.563190 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.563642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.563917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.564160 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.564329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.564481 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.564609 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.564736 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.564736 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.565012 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.565227 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.565358 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.565493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.565620 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.565760 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.565937 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.566066 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.566183 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.566316 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.566445 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.566581 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.566715 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.566841 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.566975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.567123 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.567319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.567460 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.567589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.567724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.567850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.567976 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.568101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.568325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.568456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.568627 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.568757 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.568928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.569074 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.569212 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.569347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.569516 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.569648 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.569818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.569957 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.570114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.570244 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.570413 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.570550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.570709 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.570855 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.571016 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.571146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.571312 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.571443 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.571619 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.571764 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.571899 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.572024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.572234 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.572367 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.572534 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.572674 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.572839 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.572969 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.573143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.573271 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.573464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.573619 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.573784 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.573898 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.574076 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.574188 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.574384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.574478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.574687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.574779 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.575004 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.575104 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.575309 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.575401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.575612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.575704 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.575943 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.576053 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.576284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.576382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.576611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.576809 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.576908 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.577135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.577259 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.577452 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.577581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.577776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.578100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.578200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.578400 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.578504 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.578698 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.578791 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.579020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.579127 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.579341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.579441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.579646 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.579738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.579999 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.580176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.580328 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.580459 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.580639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.580806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.580952 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.581043 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.581231 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.581331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.581534 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.581634 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.581837 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.581928 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.582147 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.582238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.582450 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.582556 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.582755 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.582847 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.583057 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.583156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.583358 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.583456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.583666 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.583762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.583991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.584282 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.584390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.584629 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.584734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.584948 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.585066 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.585336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.585490 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.585623 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.585837 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.586099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.586249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.586349 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.586537 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.586630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.586832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.586931 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.587142 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.587242 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.587457 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.587585 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.587768 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.587929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.588089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.588284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.588443 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.588590 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.588760 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.589008 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.589100 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.589317 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.589479 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.589633 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.589795 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.589953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.590120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.590260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.590445 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.590576 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.590761 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.590892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.591086 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.591199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.591412 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.591512 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.591726 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.591826 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.592051 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.592172 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.592391 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.592493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.592723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.592814 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.593070 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.593163 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.593399 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.593497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.593726 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.593825 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.594041 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.594162 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.594344 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.594438 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.594649 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.594758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.594951 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.595051 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.595258 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.595356 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.595615 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.595748 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.595970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.596155 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.596305 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.596443 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.596634 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.596791 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.596940 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.597081 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.597224 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.597371 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.597536 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.597778 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.597778 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.598053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.598199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.598346 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.598493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.598637 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.598782 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.598926 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.599064 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.599201 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.599347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.599483 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.599635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.599934 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.600088 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.600286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.600465 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.600682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.600853 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.601005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.601156 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.601297 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.601450 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.601599 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.601741 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.601891 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.602101 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.602263 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.602426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.602568 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.602710 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.602850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.603000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.603156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.603300 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.603441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.603582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.603722 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.603873 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.604028 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.604383 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.604636 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.604879 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.605026 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.605184 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.605327 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.605468 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.605609 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.605849 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.606004 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.606164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.606306 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.606456 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.606598 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.606759 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.606907 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.607063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.607205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.607349 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.607490 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.607639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.607804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.608020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.608188 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.608347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.608499 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.608653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.608653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.608937 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.608937 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.609208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.609208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.609475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.609627 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.609777 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.609934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.610085 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.610227 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.610378 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.610531 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.610674 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.610822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.610965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.611127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.611288 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.612196 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.612362 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.612517 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.612669 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.612819 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.612976 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.613138 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.613280 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.613422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.613571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.613716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.613870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.614021 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.614164 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.614405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.614554 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.614792 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.615032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.615191 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.615333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.615475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.615617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.615774 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.616011 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.616203 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.616359 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.616509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.616651 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.616807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.616950 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.617092 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 20:56:35.617248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.617248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.617248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:56:35.617248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 20:56:35.771276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO dbcounter [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Registered counter for database nova_api Jul 11 20:56:35.771503 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO dbcounter [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Registered counter for database nova_api Jul 11 20:56:35.791453 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_db.sqlalchemy.engines [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:56:35.793157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_db.sqlalchemy.engines [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118013) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:56:35.799124 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writer thread running {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:56:35.800916 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writer thread running {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:56:35.855751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.context [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e1024e7-6872-42da-8de2-23153914318d(cell1) {{(pid=118014) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 20:56:35.857104 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.context [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e1024e7-6872-42da-8de2-23153914318d(cell1) {{(pid=118013) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 20:56:35.859821 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:56:35.861225 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:56:35.861530 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:56:35.862405 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:56:35.863293 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:56:35.864149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:56:35.864491 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:56:35.866247 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:56:35.866724 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO dbcounter [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Registered counter for database nova_cell0 Jul 11 20:56:35.868418 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO dbcounter [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Registered counter for database nova_cell0 Jul 11 20:56:35.870957 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO dbcounter [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Registered counter for database nova_cell1 Jul 11 20:56:35.872547 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO dbcounter [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Registered counter for database nova_cell1 Jul 11 20:56:35.878664 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_db.sqlalchemy.engines [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:56:35.880416 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_db.sqlalchemy.engines [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118013) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:56:35.882051 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_db.sqlalchemy.engines [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:56:35.884381 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_db.sqlalchemy.engines [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118013) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:56:35.886268 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writer thread running {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:56:35.889251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writer thread running {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:56:35.889768 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writer thread running {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:56:36.026193 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writer thread running {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:56:36.035086 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO dbcounter [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Registered counter for database nova_cell0 Jul 11 20:56:36.035248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO dbcounter [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Registered counter for database nova_cell0 Jul 11 20:56:36.042963 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_db.sqlalchemy.engines [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118013) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:56:36.044307 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_db.sqlalchemy.engines [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:56:36.047855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writer thread running {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:56:36.052904 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writer thread running {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:56:36.364849 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: WARNING keystonemiddleware.auth_token [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 20:56:36.372286 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: WARNING keystonemiddleware.auth_token [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 20:56:36.373921 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: WARNING keystonemiddleware.auth_token [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 20:56:36.381898 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: WARNING keystonemiddleware.auth_token [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 20:56:36.727718 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: WARNING keystonemiddleware.auth_token [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 20:56:36.733908 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: WARNING keystonemiddleware.auth_token [None req-a93a9923-4bf7-4b94-8b9f-2084b859f44b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 20:56:36.739609 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bca05d29c0 pid: 118013 (default app) Jul 11 20:56:36.767953 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: WARNING keystonemiddleware.auth_token [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 20:56:36.774014 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: WARNING keystonemiddleware.auth_token [None req-03f360a4-bcc7-46fd-a3ff-605a986150a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 20:56:36.779351 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bca05d29c0 pid: 118014 (default app) Jul 11 20:57:17.555903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=3 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:17.557126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=3 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:17.558315 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=3 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:17.559999 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=3 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:17.873379 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:17.874265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:17.874817 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:17.876127 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:19.336422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d8558f18-7023-4746-920a-df9a2bbc538e tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Action: 'create', calling method: .version_select at 0x7f38411fc5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-193435761", "metadata": {"Type": "work"}}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:19.341614 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-85377438-762e-4511-a4ca-2aab1bed4910 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Action: 'create', calling method: .version_select at 0x7f38411f95e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1341949250", "metadata": {"Type": "work"}}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d8558f18-7023-4746-920a-df9a2bbc538e tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Request method failure captured: Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 121 Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI6toXtNm0QSuij3tHhLXiaKIwbR-tynmdOf01KULmEOND7rJe5azg_-k7qLGT4nqrsbWrcI9mZhleAAwgRSJmjybVqB0ZNT58SoRS-9yg6YiS-sEmRbrJTciZDLzKuRZaVcvifEPJj25YYOpPpVCI2YplmAlkBZqpI12oshKujPCN4 Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 20:57:19.370323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ba929f19a2c479ab6bbf8db1a064a01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 0813acc01d2f44d480a4e4c1d570db54 Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-193435761", "metadata": {"Type": "work"}}} Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: Jul 11 20:57:19.372164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-193435761', 'metadata': {'Type': 'work'}}}} Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise error Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi '#$%' Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:57:19.374157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 20:57:19.375558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 20:57:19.378235 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 20:57:19.378235 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.378235 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d8558f18-7023-4746-920a-df9a2bbc538e tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:57:19.378235 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d8558f18-7023-4746-920a-df9a2bbc538e tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.837789 Jul 11 20:57:19.378235 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jul 11 20:57:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1840 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 20:57:19.389369 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-da7d234d-c66f-4abc-a8eb-725d7dfcad03 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Action: 'create', calling method: .version_select at 0x7f3841183940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2094112129", "metadata": {"Type": "work"}}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-da7d234d-c66f-4abc-a8eb-725d7dfcad03 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Request method failure captured: Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 120 Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI6toXtNm0QSuij3tHhLXiaKIwbR-tynmdOf01KULmEOND7rJe5azg_-k7qLGT4nqrsbWrcI9mZhleAAwgRSJmjybVqB0ZNT58SoRS-9yg6YiS-sEmRbrJTciZDLzKuRZaVcvifEPJj25YYOpPpVCI2YplmAlkBZqpI12oshKujPCN4 Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 20:57:19.392039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ba929f19a2c479ab6bbf8db1a064a01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 0813acc01d2f44d480a4e4c1d570db54 Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2094112129", "metadata": {"Type": "work"}}} Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: Jul 11 20:57:19.393355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2094112129', 'metadata': {'Type': 'work'}}}} Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise error Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi '0' Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:57:19.394114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 20:57:19.395508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 20:57:19.396572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 20:57:19.396572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.406335 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-da7d234d-c66f-4abc-a8eb-725d7dfcad03 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:57:19.407251 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-da7d234d-c66f-4abc-a8eb-725d7dfcad03 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021854 Jul 11 20:57:19.407808 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 2/2] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jul 11 20:57:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 11 20:57:19.418848 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-69964494-b068-4b67-b1f8-f2ae1cc20985 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Action: 'create', calling method: .version_select at 0x7f38411fc940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1680765544", "metadata": {"Type": "work"}}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-69964494-b068-4b67-b1f8-f2ae1cc20985 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Request method failure captured: Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 119 Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI6toXtNm0QSuij3tHhLXiaKIwbR-tynmdOf01KULmEOND7rJe5azg_-k7qLGT4nqrsbWrcI9mZhleAAwgRSJmjybVqB0ZNT58SoRS-9yg6YiS-sEmRbrJTciZDLzKuRZaVcvifEPJj25YYOpPpVCI2YplmAlkBZqpI12oshKujPCN4 Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 20:57:19.425561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ba929f19a2c479ab6bbf8db1a064a01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 0813acc01d2f44d480a4e4c1d570db54 Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1680765544", "metadata": {"Type": "work"}}} Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: Jul 11 20:57:19.427439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1680765544', 'metadata': {'Type': 'work'}}}} Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise error Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi '' Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:57:19.428228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 20:57:19.429461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 20:57:19.430602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 20:57:19.430602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:19.432245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-69964494-b068-4b67-b1f8-f2ae1cc20985 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:57:19.433645 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-69964494-b068-4b67-b1f8-f2ae1cc20985 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018808 Jul 11 20:57:19.434534 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 3/3] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jul 11 20:57:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 11 20:57:19.444879 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f0605bb9-0521-46d0-99d9-0d691800ec38 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Calling method '.version_select at 0x7f38411295e0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:20.084298 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-f0605bb9-0521-46d0-99d9-0d691800ec38 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] HTTP exception thrown: Volume tempest-invalid-849708628 could not be found. Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f0605bb9-0521-46d0-99d9-0d691800ec38 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Request method failure captured: Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-849708628 HTTP/1.1 Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI6toXtNm0QSuij3tHhLXiaKIwbR-tynmdOf01KULmEOND7rJe5azg_-k7qLGT4nqrsbWrcI9mZhleAAwgRSJmjybVqB0ZNT58SoRS-9yg6YiS-sEmRbrJTciZDLzKuRZaVcvifEPJj25YYOpPpVCI2YplmAlkBZqpI12oshKujPCN4 Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 20:57:20.088079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ba929f19a2c479ab6bbf8db1a064a01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 0813acc01d2f44d480a4e4c1d570db54 Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Volume tempest-invalid-849708628 could not be found. Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'tempest-invalid-849708628'} Jul 11 20:57:20.089403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-849708628 could not be found. (HTTP 404) (Request-ID: req-dd2351ba-a568-471c-922d-d32ecd238e54) Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:20.090151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 20:57:20.091285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-849708628 could not be found. Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:57:20.092958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-849708628 could not be found. Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-849708628 could not be found. Jul 11 20:57:20.094090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.097599 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f0605bb9-0521-46d0-99d9-0d691800ec38 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Returning 404 to user: Volume tempest-invalid-849708628 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:57:20.098800 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f0605bb9-0521-46d0-99d9-0d691800ec38 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-849708628" status: 404 len: 98 microversion: 2.1 time: 0.658540 Jul 11 20:57:20.100720 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 4/4] 10.222.0.20 () {58 vars in 1214 bytes} [Mon Jul 11 20:57:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-849708628 => generated 98 bytes in 661 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 11 20:57:20.119490 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-00f8ebd3-1cef-4c5a-a831-de7ce83f63ea tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013959 Jul 11 20:57:20.121765 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 5/5] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Jul 11 20:57:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 11 20:57:20.145077 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-05ea504e-8137-4c93-9d93-bcf07ddb94f0 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016215 Jul 11 20:57:20.146946 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 6/6] 10.222.0.20 () {58 vars in 1136 bytes} [Mon Jul 11 20:57:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 11 20:57:20.166284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-55bb48cb-6d02-4aba-9c4e-37919f91043f tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Calling method '.version_select at 0x7f38410559d0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:20.882454 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-55bb48cb-6d02-4aba-9c4e-37919f91043f tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] HTTP exception thrown: Volume 759098b7-5ec9-4845-997f-cf42fdd4098b could not be found. Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-55bb48cb-6d02-4aba-9c4e-37919f91043f tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Request method failure captured: Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: DELETE /compute/v2.1/os-volumes/759098b7-5ec9-4845-997f-cf42fdd4098b HTTP/1.1 Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI6toXtNm0QSuij3tHhLXiaKIwbR-tynmdOf01KULmEOND7rJe5azg_-k7qLGT4nqrsbWrcI9mZhleAAwgRSJmjybVqB0ZNT58SoRS-9yg6YiS-sEmRbrJTciZDLzKuRZaVcvifEPJj25YYOpPpVCI2YplmAlkBZqpI12oshKujPCN4 Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 20:57:20.886047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ba929f19a2c479ab6bbf8db1a064a01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 0813acc01d2f44d480a4e4c1d570db54 Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Volume 759098b7-5ec9-4845-997f-cf42fdd4098b could not be found. Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '759098b7-5ec9-4845-997f-cf42fdd4098b'} Jul 11 20:57:20.887295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 759098b7-5ec9-4845-997f-cf42fdd4098b could not be found. (HTTP 404) (Request-ID: req-c1b71c0c-bb7a-49e0-b340-79350ccb0acc) Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:20.888166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 20:57:20.889239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 759098b7-5ec9-4845-997f-cf42fdd4098b could not be found. Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 20:57:20.890288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 759098b7-5ec9-4845-997f-cf42fdd4098b could not be found. Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 759098b7-5ec9-4845-997f-cf42fdd4098b could not be found. Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-55bb48cb-6d02-4aba-9c4e-37919f91043f tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Returning 404 to user: Volume 759098b7-5ec9-4845-997f-cf42fdd4098b could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-55bb48cb-6d02-4aba-9c4e-37919f91043f tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/759098b7-5ec9-4845-997f-cf42fdd4098b" status: 404 len: 109 microversion: 2.1 time: 0.734607 Jul 11 20:57:20.891332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 7/7] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 20:57:20 2022] DELETE /compute/v2.1/os-volumes/759098b7-5ec9-4845-997f-cf42fdd4098b => generated 109 bytes in 736 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 20:57:20.899113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f1d508b6-d9e3-4f3c-85ff-49172d6a4704 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Calling method '.version_select at 0x7f3841055e50>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:21.075295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-f1d508b6-d9e3-4f3c-85ff-49172d6a4704 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] HTTP exception thrown: Volume 3321f00a-62bf-4a8d-ba76-fc1686e87ede could not be found. Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f1d508b6-d9e3-4f3c-85ff-49172d6a4704 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Request method failure captured: Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/os-volumes/3321f00a-62bf-4a8d-ba76-fc1686e87ede HTTP/1.1 Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI6toXtNm0QSuij3tHhLXiaKIwbR-tynmdOf01KULmEOND7rJe5azg_-k7qLGT4nqrsbWrcI9mZhleAAwgRSJmjybVqB0ZNT58SoRS-9yg6YiS-sEmRbrJTciZDLzKuRZaVcvifEPJj25YYOpPpVCI2YplmAlkBZqpI12oshKujPCN4 Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 20:57:21.077953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ba929f19a2c479ab6bbf8db1a064a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ba929f19a2c479ab6bbf8db1a064a01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 8ba929f19a2c479ab6bbf8db1a064a01 Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesNegativeTest-1166819800 Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 0813acc01d2f44d480a4e4c1d570db54 Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesNegativeTest-1166819800-project Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Volume 3321f00a-62bf-4a8d-ba76-fc1686e87ede could not be found. Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '3321f00a-62bf-4a8d-ba76-fc1686e87ede'} Jul 11 20:57:21.079189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3321f00a-62bf-4a8d-ba76-fc1686e87ede could not be found. (HTTP 404) (Request-ID: req-b38b5b5f-4d83-416b-9142-a7d629ea039e) Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:21.080084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 20:57:21.081283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3321f00a-62bf-4a8d-ba76-fc1686e87ede could not be found. Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 20:57:21.082659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3321f00a-62bf-4a8d-ba76-fc1686e87ede could not be found. Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3321f00a-62bf-4a8d-ba76-fc1686e87ede could not be found. Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f1d508b6-d9e3-4f3c-85ff-49172d6a4704 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] Returning 404 to user: Volume 3321f00a-62bf-4a8d-ba76-fc1686e87ede could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:57:21.083711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f1d508b6-d9e3-4f3c-85ff-49172d6a4704 tempest-VolumesNegativeTest-1166819800 tempest-VolumesNegativeTest-1166819800-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3321f00a-62bf-4a8d-ba76-fc1686e87ede" status: 404 len: 109 microversion: 2.1 time: 0.184299 Jul 11 20:57:21.084513 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 8/8] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:20 2022] GET /compute/v2.1/os-volumes/3321f00a-62bf-4a8d-ba76-fc1686e87ede => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 20:57:22.405849 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-85377438-762e-4511-a4ca-2aab1bed4910 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.538783 Jul 11 20:57:22.408036 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 1/9] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jul 11 20:57:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4543 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 20:57:22.423613 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4dd8a43f-a65e-451e-89e1-9e6ac52bfe0d tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f3841055b80>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:22.551821 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4dd8a43f-a65e-451e-89e1-9e6ac52bfe0d tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 200 len: 353 microversion: 2.1 time: 0.135641 Jul 11 20:57:22.553143 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 9/10] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:22 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:23.565471 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1533bdd7-5afa-46e4-bdf2-eabed3d54524 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f38410c24c0>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:23.865510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1533bdd7-5afa-46e4-bdf2-eabed3d54524 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 200 len: 354 microversion: 2.1 time: 0.304292 Jul 11 20:57:23.878287 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 2/11] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:23 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 354 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:23.880201 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-41c44a67-add6-476f-9941-99da9a470d6b tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f3841055040>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:24.065234 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-41c44a67-add6-476f-9941-99da9a470d6b tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 200 len: 354 microversion: 2.1 time: 0.190934 Jul 11 20:57:24.065799 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 10/12] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:23 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:24.079179 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-586cf1ac-c10f-46b8-b1d0-bb4cae9610a1 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f38410c2700>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:24.516990 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-586cf1ac-c10f-46b8-b1d0-bb4cae9610a1 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 202 len: 0 microversion: 2.1 time: 0.442599 Jul 11 20:57:24.526314 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 3/13] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 20:57:24 2022] DELETE /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 20:57:24.527569 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8427cf25-93a5-4060-b652-8c1bdabd31eb tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f38411fc940>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:24.610655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8427cf25-93a5-4060-b652-8c1bdabd31eb tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 200 len: 353 microversion: 2.1 time: 0.088490 Jul 11 20:57:24.611964 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 11/14] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:24 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 20:57:25.630444 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ede46d7e-4ef4-4cad-8833-0946dd0acd45 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f38410c2c10>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:25.791854 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ede46d7e-4ef4-4cad-8833-0946dd0acd45 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 200 len: 353 microversion: 2.1 time: 0.169005 Jul 11 20:57:25.792173 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 4/15] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:25 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:26.804756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3cad73d4-7df0-4e5c-b940-cd9a86141a39 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f3841183940>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:26.947620 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3cad73d4-7df0-4e5c-b940-cd9a86141a39 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 200 len: 353 microversion: 2.1 time: 0.147291 Jul 11 20:57:26.948807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 12/16] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:26 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:27.292474 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-82947842", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:27.538424 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] validate_networks() for [('6b08ea06-c0b9-4a12-86e3-86d9bf3cae78', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 20:57:27.960282 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-399725a9-4de9-4c4c-8c07-c559837d2b76 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f3841129280>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:28.035930 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-399725a9-4de9-4c4c-8c07-c559837d2b76 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 200 len: 353 microversion: 2.1 time: 0.079706 Jul 11 20:57:28.036529 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 13/17] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:27 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 20:57:29.051898 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2f7ec901-a5f3-4e6e-8015-4a950972cb28 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f38410551f0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:29.193128 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2f7ec901-a5f3-4e6e-8015-4a950972cb28 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 200 len: 353 microversion: 2.1 time: 0.147897 Jul 11 20:57:29.198097 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 14/18] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:29 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 20:57:30.209741 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-986246049", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "networks": [{"uuid": "74cf7cba-fd54-40eb-913a-82a119d96b17"}]}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:30.375365 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.network.neutron [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] validate_networks() for [('74cf7cba-fd54-40eb-913a-82a119d96b17', None, None, None, None, None)] {{(pid=118013) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 20:57:30.716090 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 20:57:30.717217 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 20:57:30.717831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 20:57:30.718433 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 20:57:30.719052 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 20:57:30.733752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:30.734515 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:30.735495 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:30.736196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:30.803034 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Getting quotas for project c6f21a94f61e42c9b967e673f02eb270. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:57:30.827525 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Getting quotas for user aa7e6c5842a84e91ac94c1107ad29158 and project c6f21a94f61e42c9b967e673f02eb270. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:57:30.841531 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 20:57:30.844697 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 20:57:30.971062 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-40c1f5b9-eb2c-40f1-a37d-248663cad0bb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.967276 Jul 11 20:57:30.980130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 5/19] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 20:57:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 3977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 20:57:31.003671 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5d281067-e637-4e90-8ba2-621fe9341998 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f384076a040>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:31.185013 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5d281067-e637-4e90-8ba2-621fe9341998 tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 200 len: 353 microversion: 2.1 time: 0.203037 Jul 11 20:57:31.185696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 6/20] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:30 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 353 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:31.193241 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-44928a0e-675f-415c-b792-6b9a942b511d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:31.197865 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-44928a0e-675f-415c-b792-6b9a942b511d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:31.543670 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-44928a0e-675f-415c-b792-6b9a942b511d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:31.577714 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-44928a0e-675f-415c-b792-6b9a942b511d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1220 microversion: 2.1 time: 0.383780 Jul 11 20:57:31.594239 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 7/21] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:31 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1220 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:31.667089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-445821333", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:31.757140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Flavor limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 20:57:31.758320 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Image limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 20:57:31.758923 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Flavor pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 20:57:31.759418 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Image pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 20:57:31.759971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 20:57:31.779090 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] validate_networks() for [('6b08ea06-c0b9-4a12-86e3-86d9bf3cae78', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 20:57:31.800914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:31.803325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:31.810564 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:31.815617 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:31.969419 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Getting quotas for project dab2ba718dad487fa0f174b8b0964286. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:57:31.994883 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Getting quotas for user b5871ced3beb4decacc3a20afe523349 and project dab2ba718dad487fa0f174b8b0964286. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:57:32.038040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Going to run 1 instances... {{(pid=118013) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 20:57:32.061638 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118013) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 20:57:32.306062 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e8b1e5c9-443d-48f8-b012-96c63e50c189 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.215498 Jul 11 20:57:32.307226 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 15/22] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 20:57:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 20:57:32.315589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b76bf8ed-c283-4ae0-ac1a-5915c894682b tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Calling method '.version_select at 0x7f3840f5d670>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:32.577451 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-b76bf8ed-c283-4ae0-ac1a-5915c894682b tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] HTTP exception thrown: Volume d49db361-2984-471d-aa3c-15b51a576d23 could not be found. Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b76bf8ed-c283-4ae0-ac1a-5915c894682b tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Request method failure captured: Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 HTTP/1.1 Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI6tmRb5Xy8eGTm9FYnu-sVDNADyja-uxjiZX70KRN2Jr7JtKOYfh6USQiMzSblkoAmS-0UKemgg5_hqdM9ZJYnZQIwDKcUcfklREAd99rxIv7dPRkXr8itdI2Q87Hg0eGyqg9MBakP22BqZ84itO7pn-vhmHkuwQtBkCE6ep1-vAZQ Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 6001641b8786432fbe8c94c64855139a Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesGetTestJSON-1791203349 Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 20:57:32.580032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6001641b8786432fbe8c94c64855139a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6001641b8786432fbe8c94c64855139a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6001641b8786432fbe8c94c64855139a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6001641b8786432fbe8c94c64855139a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesGetTestJSON-1791203349 Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 6001641b8786432fbe8c94c64855139a Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesGetTestJSON-1791203349 Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesGetTestJSON-1791203349-project Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 0b03a4195935439e923932201f357623 Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesGetTestJSON-1791203349-project Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Volume d49db361-2984-471d-aa3c-15b51a576d23 could not be found. Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'd49db361-2984-471d-aa3c-15b51a576d23'} Jul 11 20:57:32.581192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d49db361-2984-471d-aa3c-15b51a576d23 could not be found. (HTTP 404) (Request-ID: req-4cb8906e-f7c8-40cf-99cf-1c5d2d0873fb) Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:32.581881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 20:57:32.583025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d49db361-2984-471d-aa3c-15b51a576d23 could not be found. Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 20:57:32.583981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d49db361-2984-471d-aa3c-15b51a576d23 could not be found. Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d49db361-2984-471d-aa3c-15b51a576d23 could not be found. Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b76bf8ed-c283-4ae0-ac1a-5915c894682b tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] Returning 404 to user: Volume d49db361-2984-471d-aa3c-15b51a576d23 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b76bf8ed-c283-4ae0-ac1a-5915c894682b tempest-VolumesGetTestJSON-1791203349 tempest-VolumesGetTestJSON-1791203349-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23" status: 404 len: 109 microversion: 2.1 time: 0.272674 Jul 11 20:57:32.587829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 16/23] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:32 2022] GET /compute/v2.1/os-volumes/d49db361-2984-471d-aa3c-15b51a576d23 => generated 109 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 20:57:32.608426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b917609a-31b6-4ee6-9ab9-20bb16684160 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:32.614472 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b917609a-31b6-4ee6-9ab9-20bb16684160 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:32.920359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b917609a-31b6-4ee6-9ab9-20bb16684160 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:32.967698 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b917609a-31b6-4ee6-9ab9-20bb16684160 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1214 microversion: 2.1 time: 0.381326 Jul 11 20:57:32.971700 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 17/24] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:32 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1214 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:33.990041 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e850b217-6c85-4fbe-aadf-2f3cec85f780 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:33.991398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e850b217-6c85-4fbe-aadf-2f3cec85f780 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:34.287471 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e850b217-6c85-4fbe-aadf-2f3cec85f780 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:34.310376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e850b217-6c85-4fbe-aadf-2f3cec85f780 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1214 microversion: 2.1 time: 0.326016 Jul 11 20:57:34.314725 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 18/25] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:33 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1214 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:57:34.825263 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-634fa9e5-c320-463e-9013-db818b606c21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'create', calling method: .version_select at 0x7f38406ffca0>, body: {"keypair": {"name": "tempest-keypair-2095672979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdfiLcU65DhU8AypFkGau6NNdTHao/DkiIG5uRIik+X7DnBrdHySyxoiFJkq9Ed10TkZefKZWkhhiIQv5WhQowp2Y37GZTwDBUYDo3NCahkpYtf/cH8o4JJ3K7XdFBxBg=="}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:34.880536 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-634fa9e5-c320-463e-9013-db818b606c21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Getting quotas for project 367a52be93e24b5eaf528a48342d47b3. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:57:34.890420 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-634fa9e5-c320-463e-9013-db818b606c21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Getting quotas for user 0965444614ae486e80e111f4126b52f1 and project 367a52be93e24b5eaf528a48342d47b3. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:57:34.995436 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-634fa9e5-c320-463e-9013-db818b606c21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.576908 Jul 11 20:57:35.006745 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 19/26] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 20:57:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:35.331185 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cae9c426-6057-468f-97f7-58ed4805323e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:35.332957 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-cae9c426-6057-468f-97f7-58ed4805323e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:35.352799 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cae9c426-6057-468f-97f7-58ed4805323e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:35.353275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cae9c426-6057-468f-97f7-58ed4805323e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:35.364590 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cae9c426-6057-468f-97f7-58ed4805323e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:35.365784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cae9c426-6057-468f-97f7-58ed4805323e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:35.471719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 20:57:35.472540 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 20:57:35.473113 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 20:57:35.473278 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 20:57:35.473994 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 20:57:35.493331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:35.503086 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:35.506355 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:35.508283 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:35.566814 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Getting quotas for project c6f21a94f61e42c9b967e673f02eb270. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:57:35.575350 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Getting quotas for user aa7e6c5842a84e91ac94c1107ad29158 and project c6f21a94f61e42c9b967e673f02eb270. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:57:35.589410 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 20:57:35.592677 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 20:57:35.715812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-61e3e483-a45c-414b-8b0a-f451036a445c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.047889 Jul 11 20:57:35.729733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 8/27] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 20:57:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 4067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 20:57:35.756817 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-3e336c87-97ae-4da2-921e-721d25d350bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:35.757487 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-3e336c87-97ae-4da2-921e-721d25d350bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:35.866740 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-cae9c426-6057-468f-97f7-58ed4805323e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:35.899466 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-cae9c426-6057-468f-97f7-58ed4805323e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1218 microversion: 2.1 time: 0.567991 Jul 11 20:57:35.902835 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 20/28] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:35 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1218 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:57:35.906627 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3e336c87-97ae-4da2-921e-721d25d350bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:35.917183 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-3e336c87-97ae-4da2-921e-721d25d350bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1221 microversion: 2.1 time: 0.180593 Jul 11 20:57:35.921196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 9/29] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:35 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1221 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:36.512561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8752a4cd-06b4-4810-bbb3-8df28375194f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'create', calling method: .version_select at 0x7f384062e5e0>, body: {"keypair": {"name": "tempest-keypair-1753453566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYZ+0nyxPG1UeH2r6lRSbTTZsgBqftPv5Rmu+MhZsMUFZaty9ACig0cUy6BEvhn0o/JMpIc4wdk17UkAzgedmjK4ESsOG8TOszc80N8vfLjwrMU2LI6s4M74HcOlryL3Q=="}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:36.543414 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-8752a4cd-06b4-4810-bbb3-8df28375194f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Getting quotas for project 570d2b4d5c384612ba17efc8b5bd02ec. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:57:36.547997 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-8752a4cd-06b4-4810-bbb3-8df28375194f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Getting quotas for user 77cf43c378a9413dbd799a00bfa21eb8 and project 570d2b4d5c384612ba17efc8b5bd02ec. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:57:36.585382 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8752a4cd-06b4-4810-bbb3-8df28375194f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.289553 Jul 11 20:57:36.586376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 21/30] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Jul 11 20:57:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 291 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 11 20:57:36.918891 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4de1393e-f171-4a52-9493-d5e5320bb3f9 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:36.920060 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4de1393e-f171-4a52-9493-d5e5320bb3f9 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:36.927101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4de1393e-f171-4a52-9493-d5e5320bb3f9 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:36.927911 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4de1393e-f171-4a52-9493-d5e5320bb3f9 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:36.928968 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4de1393e-f171-4a52-9493-d5e5320bb3f9 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:36.929660 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4de1393e-f171-4a52-9493-d5e5320bb3f9 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:36.938326 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5bacb252-8a92-4167-af7c-918b1031dd1e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:36.939255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5bacb252-8a92-4167-af7c-918b1031dd1e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:36.946631 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5bacb252-8a92-4167-af7c-918b1031dd1e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:36.947086 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5bacb252-8a92-4167-af7c-918b1031dd1e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:36.947861 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5bacb252-8a92-4167-af7c-918b1031dd1e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:36.948324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5bacb252-8a92-4167-af7c-918b1031dd1e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:37.043747 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5bacb252-8a92-4167-af7c-918b1031dd1e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:37.052178 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5bacb252-8a92-4167-af7c-918b1031dd1e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1225 microversion: 2.1 time: 0.117560 Jul 11 20:57:37.053033 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 22/31] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:36 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:37.151158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4de1393e-f171-4a52-9493-d5e5320bb3f9 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:37.164215 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4de1393e-f171-4a52-9493-d5e5320bb3f9 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1218 microversion: 2.1 time: 0.249097 Jul 11 20:57:37.168053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 10/32] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:36 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1218 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:38.070365 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-39178726", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff1ba024-4762-40b1-8a58-2da0dcdba95a"}], "security_groups": [{"name": "tempest-securitygroup--1332020539"}], "key_name": "tempest-keypair-2095672979", "user_data": "}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:38.085369 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1e846074-a9e6-41aa-8d21-d5e2699af216 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:38.087909 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1e846074-a9e6-41aa-8d21-d5e2699af216 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:38.101490 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1e846074-a9e6-41aa-8d21-d5e2699af216 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:38.107416 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1e846074-a9e6-41aa-8d21-d5e2699af216 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:38.108568 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1e846074-a9e6-41aa-8d21-d5e2699af216 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:38.111623 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1e846074-a9e6-41aa-8d21-d5e2699af216 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:38.267635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.network.neutron [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] validate_networks() for [('ff1ba024-4762-40b1-8a58-2da0dcdba95a', None, None, None, None, None)] {{(pid=118013) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 20:57:38.382764 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1e846074-a9e6-41aa-8d21-d5e2699af216 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:38.396538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1e846074-a9e6-41aa-8d21-d5e2699af216 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1225 microversion: 2.1 time: 0.320241 Jul 11 20:57:38.399309 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 11/33] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:38 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1225 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:57:38.413550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-798d210a-0bc1-49d4-8788-e93b741bcc04 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:38.414568 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-798d210a-0bc1-49d4-8788-e93b741bcc04 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:38.440837 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-798d210a-0bc1-49d4-8788-e93b741bcc04 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:38.441500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-798d210a-0bc1-49d4-8788-e93b741bcc04 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:38.442619 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-798d210a-0bc1-49d4-8788-e93b741bcc04 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:38.443483 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-798d210a-0bc1-49d4-8788-e93b741bcc04 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:38.776771 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-798d210a-0bc1-49d4-8788-e93b741bcc04 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:38.787859 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-798d210a-0bc1-49d4-8788-e93b741bcc04 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1218 microversion: 2.1 time: 0.387029 Jul 11 20:57:38.788480 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 12/34] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:38 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1218 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:39.079226 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Flavor limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 20:57:39.079694 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Image limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 20:57:39.080165 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Flavor pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 20:57:39.080815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Image pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 20:57:39.081222 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 20:57:39.106519 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:39.109141 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:39.109901 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:39.110999 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:39.173663 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Getting quotas for project 367a52be93e24b5eaf528a48342d47b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:57:39.181226 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Getting quotas for user 0965444614ae486e80e111f4126b52f1 and project 367a52be93e24b5eaf528a48342d47b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:57:39.216427 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Going to run 1 instances... {{(pid=118013) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 20:57:39.221227 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118013) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 20:57:39.348619 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-74abefc0-4a5f-45c6-a693-a039a46be976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.283581 Jul 11 20:57:39.351529 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 23/35] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 20:57:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 20:57:39.361808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c83482e1-5bef-4786-af41-398c8b93af35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:39.363206 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c83482e1-5bef-4786-af41-398c8b93af35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:39.415693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d0850d01-f6f7-4338-9f91-5cd01bb8a78d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:39.416554 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d0850d01-f6f7-4338-9f91-5cd01bb8a78d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:39.424195 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0850d01-f6f7-4338-9f91-5cd01bb8a78d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:39.424989 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0850d01-f6f7-4338-9f91-5cd01bb8a78d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:39.426489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0850d01-f6f7-4338-9f91-5cd01bb8a78d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:39.438803 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0850d01-f6f7-4338-9f91-5cd01bb8a78d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:39.546978 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c83482e1-5bef-4786-af41-398c8b93af35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:39.558385 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c83482e1-5bef-4786-af41-398c8b93af35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1236 microversion: 2.1 time: 0.200334 Jul 11 20:57:39.572020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 13/36] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:39 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1236 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:39.584026 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2127413079", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6286643-5950-4434-a797-420c7c45a93b"}], "security_groups": [{"name": "tempest-securitygroup--1862643414"}], "key_name": "tempest-keypair-1753453566", "user_data": "}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:39.654397 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d0850d01-f6f7-4338-9f91-5cd01bb8a78d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:39.669550 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d0850d01-f6f7-4338-9f91-5cd01bb8a78d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1217 microversion: 2.1 time: 0.257359 Jul 11 20:57:39.679681 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 24/37] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:39 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1217 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:39.812395 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d9fa3b24-3c51-4e4b-a7e5-fe718573eb3c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:39.823205 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d9fa3b24-3c51-4e4b-a7e5-fe718573eb3c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:39.838922 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d9fa3b24-3c51-4e4b-a7e5-fe718573eb3c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:39.840281 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d9fa3b24-3c51-4e4b-a7e5-fe718573eb3c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:39.841756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d9fa3b24-3c51-4e4b-a7e5-fe718573eb3c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:39.843573 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d9fa3b24-3c51-4e4b-a7e5-fe718573eb3c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:39.853325 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] validate_networks() for [('b6286643-5950-4434-a797-420c7c45a93b', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 20:57:40.075382 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d9fa3b24-3c51-4e4b-a7e5-fe718573eb3c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:40.085698 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d9fa3b24-3c51-4e4b-a7e5-fe718573eb3c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1266 microversion: 2.1 time: 0.285029 Jul 11 20:57:40.098615 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 25/38] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:39 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:40.581699 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-800145f3-1585-4d76-aace-9dd81ac1738f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:40.582581 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-800145f3-1585-4d76-aace-9dd81ac1738f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:40.598256 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-800145f3-1585-4d76-aace-9dd81ac1738f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:40.598967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-800145f3-1585-4d76-aace-9dd81ac1738f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:40.599988 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-800145f3-1585-4d76-aace-9dd81ac1738f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:40.600579 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-800145f3-1585-4d76-aace-9dd81ac1738f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:40.795126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-800145f3-1585-4d76-aace-9dd81ac1738f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:40.840995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-800145f3-1585-4d76-aace-9dd81ac1738f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1240 microversion: 2.1 time: 0.237227 Jul 11 20:57:40.847631 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 26/39] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:40 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1240 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:57:40.872071 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ff221cf1-7b75-4c09-b0b9-56b285892838 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:40.875096 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ff221cf1-7b75-4c09-b0b9-56b285892838 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:40.905215 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff221cf1-7b75-4c09-b0b9-56b285892838 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:40.907542 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff221cf1-7b75-4c09-b0b9-56b285892838 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:40.911109 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff221cf1-7b75-4c09-b0b9-56b285892838 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:40.912551 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff221cf1-7b75-4c09-b0b9-56b285892838 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:41.027376 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 20:57:41.027887 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 20:57:41.028628 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 20:57:41.029232 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 20:57:41.029734 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 20:57:41.059744 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:41.060344 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:41.061557 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:41.062363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:41.111640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Getting quotas for project 570d2b4d5c384612ba17efc8b5bd02ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:57:41.123767 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Getting quotas for user 77cf43c378a9413dbd799a00bfa21eb8 and project 570d2b4d5c384612ba17efc8b5bd02ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:57:41.191326 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 20:57:41.197743 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 20:57:41.351496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-77264bce-eae7-4f22-afa5-542f671051f7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.771944 Jul 11 20:57:41.356674 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 14/40] 10.222.0.20 () {62 vars in 1187 bytes} [Mon Jul 11 20:57:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 11 20:57:41.370246 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2a013d73-0e18-4cff-9914-cd5e6d897d5e tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f384076a430>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:41.436434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ff221cf1-7b75-4c09-b0b9-56b285892838 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:41.450113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ff221cf1-7b75-4c09-b0b9-56b285892838 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1291 microversion: 2.1 time: 0.601270 Jul 11 20:57:41.450709 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 27/41] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:40 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1291 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:41.466557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-221236c0-acba-4f75-b699-c10878068038 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:41.468938 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-221236c0-acba-4f75-b699-c10878068038 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:41.493384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-221236c0-acba-4f75-b699-c10878068038 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:41.496482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-221236c0-acba-4f75-b699-c10878068038 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:41.497948 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-221236c0-acba-4f75-b699-c10878068038 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:41.498389 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-221236c0-acba-4f75-b699-c10878068038 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:41.619466 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2a013d73-0e18-4cff-9914-cd5e6d897d5e tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ce69ea86-ed22-4db0-8f44-f87d004fa00d" status: 200 len: 351 microversion: 2.1 time: 0.260972 Jul 11 20:57:41.621944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 15/42] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:41 2022] GET /compute/v2.1/os-volumes/ce69ea86-ed22-4db0-8f44-f87d004fa00d => generated 351 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:41.635037 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-76c5ae2e-ea5c-4b8e-826a-d1dc71daa040 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:41.636271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-76c5ae2e-ea5c-4b8e-826a-d1dc71daa040 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:41.898722 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-221236c0-acba-4f75-b699-c10878068038 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:41.909565 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-221236c0-acba-4f75-b699-c10878068038 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1272 microversion: 2.1 time: 0.453021 Jul 11 20:57:41.911107 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 28/43] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:41 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1272 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:41.919985 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-76c5ae2e-ea5c-4b8e-826a-d1dc71daa040 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:41.933198 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-76c5ae2e-ea5c-4b8e-826a-d1dc71daa040 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:41.934692 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-68938ac5-d6fa-418c-a678-ec84f376e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:41.938203 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-68938ac5-d6fa-418c-a678-ec84f376e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:41.954236 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-76c5ae2e-ea5c-4b8e-826a-d1dc71daa040 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:41.958526 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-76c5ae2e-ea5c-4b8e-826a-d1dc71daa040 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1282 microversion: 2.20 time: 0.334269 Jul 11 20:57:41.959554 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68938ac5-d6fa-418c-a678-ec84f376e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:41.961633 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68938ac5-d6fa-418c-a678-ec84f376e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:41.962162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 16/44] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:41 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1282 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:57:41.987455 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68938ac5-d6fa-418c-a678-ec84f376e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:41.988146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68938ac5-d6fa-418c-a678-ec84f376e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:42.235487 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-68938ac5-d6fa-418c-a678-ec84f376e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:42.250921 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-68938ac5-d6fa-418c-a678-ec84f376e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1296 microversion: 2.1 time: 0.328065 Jul 11 20:57:42.252231 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 29/45] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:41 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1296 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:42.470175 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-86a4434c-e2bd-4f46-8c67-296ff239b6e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:42.471758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-86a4434c-e2bd-4f46-8c67-296ff239b6e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:42.485080 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-86a4434c-e2bd-4f46-8c67-296ff239b6e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:42.486785 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-86a4434c-e2bd-4f46-8c67-296ff239b6e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:42.490107 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-86a4434c-e2bd-4f46-8c67-296ff239b6e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:42.491229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-86a4434c-e2bd-4f46-8c67-296ff239b6e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:42.780658 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-86a4434c-e2bd-4f46-8c67-296ff239b6e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:42.807773 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-86a4434c-e2bd-4f46-8c67-296ff239b6e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1279 microversion: 2.1 time: 0.342604 Jul 11 20:57:42.809391 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 17/46] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:42 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1279 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:57:42.930652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8085ace4-3194-44c3-959e-7f5bee66d53a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:42.932090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8085ace4-3194-44c3-959e-7f5bee66d53a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:42.952977 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8085ace4-3194-44c3-959e-7f5bee66d53a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:42.953428 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8085ace4-3194-44c3-959e-7f5bee66d53a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:42.954228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8085ace4-3194-44c3-959e-7f5bee66d53a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:42.954665 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8085ace4-3194-44c3-959e-7f5bee66d53a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:42.988646 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:42.993146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:43.038341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:43.038792 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:43.039628 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:43.040069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:43.238901 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:43.266113 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:43.271510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:43.272761 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-31bbc75e-d4e9-47e0-a473-58d955ac0eb1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1334 microversion: 2.20 time: 0.289837 Jul 11 20:57:43.289567 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 18/47] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:42 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1334 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:57:43.294747 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-3cd0ba0d-a78c-4f07-a695-9be49cedf79a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:43.295587 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-3cd0ba0d-a78c-4f07-a695-9be49cedf79a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:43.302631 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3cd0ba0d-a78c-4f07-a695-9be49cedf79a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:43.303309 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3cd0ba0d-a78c-4f07-a695-9be49cedf79a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:43.304307 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3cd0ba0d-a78c-4f07-a695-9be49cedf79a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:43.304889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3cd0ba0d-a78c-4f07-a695-9be49cedf79a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:43.345429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8085ace4-3194-44c3-959e-7f5bee66d53a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:43.373005 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8085ace4-3194-44c3-959e-7f5bee66d53a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1272 microversion: 2.1 time: 0.449306 Jul 11 20:57:43.373617 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 30/48] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:42 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1272 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:43.497953 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3cd0ba0d-a78c-4f07-a695-9be49cedf79a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:43.512070 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-3cd0ba0d-a78c-4f07-a695-9be49cedf79a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1294 microversion: 2.1 time: 0.221094 Jul 11 20:57:43.515228 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 19/49] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:43 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1294 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:43.592997 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-798ddb03-6043-42db-8ca4-ee48789dd46a tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f384061a790>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:43.727233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-798ddb03-6043-42db-8ca4-ee48789dd46a tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/1acd8d52-9b20-4257-9950-1ffe2e25343a" status: 200 len: 351 microversion: 2.1 time: 0.138492 Jul 11 20:57:43.728412 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 31/50] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:43 2022] GET /compute/v2.1/os-volumes/1acd8d52-9b20-4257-9950-1ffe2e25343a => generated 351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 20:57:43.825402 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-eb7c5068-9227-43b7-b9f5-cc35d8d40ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:43.826041 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-eb7c5068-9227-43b7-b9f5-cc35d8d40ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:43.838988 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-eb7c5068-9227-43b7-b9f5-cc35d8d40ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:43.839449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-eb7c5068-9227-43b7-b9f5-cc35d8d40ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:43.840268 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-eb7c5068-9227-43b7-b9f5-cc35d8d40ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:43.840709 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-eb7c5068-9227-43b7-b9f5-cc35d8d40ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:44.296813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:44.297719 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:44.311104 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:44.314153 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:44.318372 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:44.319120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:44.798391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:44.825075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:44.831962 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:44.833575 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-160542f5-d297-4934-a38a-d54938aee5d1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1340 microversion: 2.20 time: 0.540896 Jul 11 20:57:44.835834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 32/51] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:44 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1340 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 20:57:44.849819 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ff7cfb92-2b66-48e9-a12d-bdf4f59ba058 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:44.863051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ff7cfb92-2b66-48e9-a12d-bdf4f59ba058 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:44.875731 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff7cfb92-2b66-48e9-a12d-bdf4f59ba058 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:44.876410 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff7cfb92-2b66-48e9-a12d-bdf4f59ba058 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:44.877570 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff7cfb92-2b66-48e9-a12d-bdf4f59ba058 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:44.878225 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff7cfb92-2b66-48e9-a12d-bdf4f59ba058 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:45.950393 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-eb7c5068-9227-43b7-b9f5-cc35d8d40ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:45.959822 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-eb7c5068-9227-43b7-b9f5-cc35d8d40ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 2.138214 Jul 11 20:57:45.978453 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 20/52] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:43 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:45.992851 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ca9ff633-784b-4001-9b46-f3fbb8fe51b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:46.002378 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ca9ff633-784b-4001-9b46-f3fbb8fe51b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:46.023199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca9ff633-784b-4001-9b46-f3fbb8fe51b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:46.023647 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca9ff633-784b-4001-9b46-f3fbb8fe51b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:46.024454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca9ff633-784b-4001-9b46-f3fbb8fe51b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:46.024885 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca9ff633-784b-4001-9b46-f3fbb8fe51b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:46.215270 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ca9ff633-784b-4001-9b46-f3fbb8fe51b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:46.229671 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ca9ff633-784b-4001-9b46-f3fbb8fe51b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1294 microversion: 2.1 time: 0.249558 Jul 11 20:57:46.234168 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 21/53] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:45 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1294 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:46.250252 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:46.254155 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:46.270000 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:46.275368 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:46.276233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:46.276667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:46.517507 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:46.529525 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:46.531193 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:46.532361 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4db3d194-4ade-4ff7-8302-4684f66ac3a9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1340 microversion: 2.20 time: 0.295755 Jul 11 20:57:46.532928 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 22/54] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:46 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1340 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:57:46.561194 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c386e589-3c6c-459e-954b-7eb1ae0623c8 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f384069ad30>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:46.707597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c386e589-3c6c-459e-954b-7eb1ae0623c8 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/36b33c19-62fc-4799-87fd-4c32a47cb552" status: 200 len: 350 microversion: 2.1 time: 0.158798 Jul 11 20:57:46.708693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 23/55] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 20:57:46 2022] GET /compute/v2.1/os-volumes/36b33c19-62fc-4799-87fd-4c32a47cb552 => generated 350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:46.726535 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-63168599-31bd-4f5f-95e6-66ba8611c42e tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f3840718820>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:47.026404 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-63168599-31bd-4f5f-95e6-66ba8611c42e tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.309704 Jul 11 20:57:47.027429 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 24/56] 10.222.0.20 () {58 vars in 1133 bytes} [Mon Jul 11 20:57:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:47.032512 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-516bb9d2-e4a0-4038-9bc9-b2e2333508fd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:47.032972 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-516bb9d2-e4a0-4038-9bc9-b2e2333508fd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:47.064200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-516bb9d2-e4a0-4038-9bc9-b2e2333508fd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:47.065011 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-516bb9d2-e4a0-4038-9bc9-b2e2333508fd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:47.066215 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-516bb9d2-e4a0-4038-9bc9-b2e2333508fd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:47.066834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-516bb9d2-e4a0-4038-9bc9-b2e2333508fd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:47.209021 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ff7cfb92-2b66-48e9-a12d-bdf4f59ba058 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:47.226029 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ff7cfb92-2b66-48e9-a12d-bdf4f59ba058 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 2.388192 Jul 11 20:57:47.254207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 33/57] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:44 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 2417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:47.263652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3b054cb5-0976-49df-8325-85319d370df5 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f38406504c0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:47.564976 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3b054cb5-0976-49df-8325-85319d370df5 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.309431 Jul 11 20:57:47.572928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 34/58] 10.222.0.20 () {58 vars in 1148 bytes} [Mon Jul 11 20:57:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:47.572928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-96fdd5e8-f1f8-4a0a-80f4-5546db26a6ee tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:47.572928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-96fdd5e8-f1f8-4a0a-80f4-5546db26a6ee tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:47.596455 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-96fdd5e8-f1f8-4a0a-80f4-5546db26a6ee tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:47.605926 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-96fdd5e8-f1f8-4a0a-80f4-5546db26a6ee tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:47.608709 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-96fdd5e8-f1f8-4a0a-80f4-5546db26a6ee tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:47.610197 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-96fdd5e8-f1f8-4a0a-80f4-5546db26a6ee tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:48.467516 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-516bb9d2-e4a0-4038-9bc9-b2e2333508fd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:48.481897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-516bb9d2-e4a0-4038-9bc9-b2e2333508fd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 1.447741 Jul 11 20:57:48.489569 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 25/59] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:47 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:48.521600 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:48.534522 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:48.562035 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:48.566641 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:48.571340 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:48.574312 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:48.575734 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:48.665110 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-96fdd5e8-f1f8-4a0a-80f4-5546db26a6ee tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:48.681856 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-96fdd5e8-f1f8-4a0a-80f4-5546db26a6ee tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 1.114261 Jul 11 20:57:48.693751 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 35/60] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:47 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:48.732247 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b8af4638-8ca5-4b61-990b-8b11e9ca79a8 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f3840604670>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:49.093325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b8af4638-8ca5-4b61-990b-8b11e9ca79a8 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.394651 Jul 11 20:57:49.093932 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 36/61] 10.222.0.20 () {58 vars in 1133 bytes} [Mon Jul 11 20:57:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:49.107245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-bcb910c3-fbdf-499f-b7cc-12dc3cc95224 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:49.107846 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-bcb910c3-fbdf-499f-b7cc-12dc3cc95224 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:49.132917 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bcb910c3-fbdf-499f-b7cc-12dc3cc95224 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:49.134398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bcb910c3-fbdf-499f-b7cc-12dc3cc95224 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:49.139190 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bcb910c3-fbdf-499f-b7cc-12dc3cc95224 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:49.139824 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bcb910c3-fbdf-499f-b7cc-12dc3cc95224 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:49.148840 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=4 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:49.155141 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:49.164379 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:49.186226 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:49.187681 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-378598b0-d4f3-4441-aa79-7ed218146ffc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1340 microversion: 2.20 time: 0.687622 Jul 11 20:57:49.199688 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 26/62] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:48 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1340 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:57:49.215969 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1659aa50-c6f6-49df-b49d-ff8e6e11b566 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f38406845e0>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:49.218686 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=24 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:49.396772 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1659aa50-c6f6-49df-b49d-ff8e6e11b566 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.195774 Jul 11 20:57:49.397895 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 27/63] 10.222.0.20 () {58 vars in 1166 bytes} [Mon Jul 11 20:57:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:49.413283 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-62bb02c1-7844-4557-8372-1e478843b12f tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f384069a0d0>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:49.715812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-62bb02c1-7844-4557-8372-1e478843b12f tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.307561 Jul 11 20:57:49.723884 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 28/64] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Jul 11 20:57:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:49.723884 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-07aa6a3d-6e16-4bc0-bce4-27f7845d8e77 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:49.723884 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-07aa6a3d-6e16-4bc0-bce4-27f7845d8e77 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:49.740775 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-07aa6a3d-6e16-4bc0-bce4-27f7845d8e77 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:49.751911 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-07aa6a3d-6e16-4bc0-bce4-27f7845d8e77 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:49.753349 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-07aa6a3d-6e16-4bc0-bce4-27f7845d8e77 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:49.767625 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-07aa6a3d-6e16-4bc0-bce4-27f7845d8e77 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:50.830174 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-bcb910c3-fbdf-499f-b7cc-12dc3cc95224 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:50.841812 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-bcb910c3-fbdf-499f-b7cc-12dc3cc95224 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 1.738543 Jul 11 20:57:50.848969 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 37/65] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:49 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:50.866468 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-30d467e6-51ee-4e5f-8c62-01b7ae7244a8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:50.869043 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-30d467e6-51ee-4e5f-8c62-01b7ae7244a8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:50.892187 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30d467e6-51ee-4e5f-8c62-01b7ae7244a8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:50.893238 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30d467e6-51ee-4e5f-8c62-01b7ae7244a8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:50.895359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30d467e6-51ee-4e5f-8c62-01b7ae7244a8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:50.900940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30d467e6-51ee-4e5f-8c62-01b7ae7244a8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:51.089163 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:51.407450 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-07aa6a3d-6e16-4bc0-bce4-27f7845d8e77 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:51.437079 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-07aa6a3d-6e16-4bc0-bce4-27f7845d8e77 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 1.708460 Jul 11 20:57:51.447778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 29/66] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:49 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:51.459144 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-99e3886e-5ceb-43df-95f2-bba4b6b914be tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f38406c2e50>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:51.606276 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-99e3886e-5ceb-43df-95f2-bba4b6b914be tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.156711 Jul 11 20:57:51.610608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 30/67] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Jul 11 20:57:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:51.618870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:51.620647 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:51.630313 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:51.631395 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:51.632527 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:51.633154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:51.926042 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=26 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:52.870946 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:52.882188 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:52.884470 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:52.886474 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0dfe49d3-e6c1-47c7-bda2-39d198555d23 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 1.273981 Jul 11 20:57:52.887346 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 31/68] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:51 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:57:52.904631 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-41fb4fa2-4d83-4d04-9e13-b50afcad3c01 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f3840684f70>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:53.124744 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-41fb4fa2-4d83-4d04-9e13-b50afcad3c01 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.235916 Jul 11 20:57:53.126507 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 32/69] 10.222.0.20 () {58 vars in 1187 bytes} [Mon Jul 11 20:57:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:53.135152 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c05d5939-ad97-4bfe-beb5-b0e52f495223 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:53.138121 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c05d5939-ad97-4bfe-beb5-b0e52f495223 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:53.153821 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c05d5939-ad97-4bfe-beb5-b0e52f495223 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:53.156006 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c05d5939-ad97-4bfe-beb5-b0e52f495223 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:53.157535 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c05d5939-ad97-4bfe-beb5-b0e52f495223 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:53.158197 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c05d5939-ad97-4bfe-beb5-b0e52f495223 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:53.433429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-30d467e6-51ee-4e5f-8c62-01b7ae7244a8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:53.448267 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-30d467e6-51ee-4e5f-8c62-01b7ae7244a8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 2.596537 Jul 11 20:57:53.452673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 38/70] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:50 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 2603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:53.468626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8faa15f4-a1db-4e6a-aaeb-82bb03877c43 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:53.469198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8faa15f4-a1db-4e6a-aaeb-82bb03877c43 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:53.495814 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8faa15f4-a1db-4e6a-aaeb-82bb03877c43 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:53.496308 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8faa15f4-a1db-4e6a-aaeb-82bb03877c43 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:53.497479 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8faa15f4-a1db-4e6a-aaeb-82bb03877c43 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:53.497921 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8faa15f4-a1db-4e6a-aaeb-82bb03877c43 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:53.915048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c05d5939-ad97-4bfe-beb5-b0e52f495223 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:53.937507 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c05d5939-ad97-4bfe-beb5-b0e52f495223 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.807072 Jul 11 20:57:53.945114 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 33/71] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:53 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:54.063170 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-7c301abb-e0d3-45cd-861c-c9124c298875 req-4883ffe4-d123-491c-bbea-cb81780de3ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ba91b13-c6e9-4273-b62f-09daf6fa9052", "tag": "d120ab5c-f331-4514-ab2f-aae660b85d36"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:54.086308 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-7c301abb-e0d3-45cd-861c-c9124c298875 req-4883ffe4-d123-491c-bbea-cb81780de3ca service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:54.086993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-7c301abb-e0d3-45cd-861c-c9124c298875 req-4883ffe4-d123-491c-bbea-cb81780de3ca service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:54.134451 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-7c301abb-e0d3-45cd-861c-c9124c298875 req-4883ffe4-d123-491c-bbea-cb81780de3ca service nova] Creating event network-changed:d120ab5c-f331-4514-ab2f-aae660b85d36 for instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 on hv-cinder-84902 Jul 11 20:57:54.135347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-7c301abb-e0d3-45cd-861c-c9124c298875 req-4883ffe4-d123-491c-bbea-cb81780de3ca service nova] Acquired lock "compute-rpcapi-router" {{(pid=118014) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 20:57:54.137350 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4c4c0cff-080d-42db-896f-d4f53bde1104 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:54.138107 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4c4c0cff-080d-42db-896f-d4f53bde1104 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:54.139188 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4c4c0cff-080d-42db-896f-d4f53bde1104 None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:54.139821 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4c4c0cff-080d-42db-896f-d4f53bde1104 None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:54.158837 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.compute.rpcapi [None req-4c4c0cff-080d-42db-896f-d4f53bde1104 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 20:57:54.161210 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4c4c0cff-080d-42db-896f-d4f53bde1104 None None] Releasing lock "compute-rpcapi-router" {{(pid=118014) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 20:57:54.214061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4c4c0cff-080d-42db-896f-d4f53bde1104 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263813 Jul 11 20:57:54.217289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 34/72] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:54.275168 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8faa15f4-a1db-4e6a-aaeb-82bb03877c43 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:54.294261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8faa15f4-a1db-4e6a-aaeb-82bb03877c43 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.832416 Jul 11 20:57:54.295598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 39/73] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:53 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:54.305073 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-476a2c36-f284-4413-9646-ea424096fa49 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] Calling method '.version_select at 0x7f38405d3b80>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:54.374993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-b6b862b0-8c5e-4325-9a46-bd8a8d94f8cb req-f480e034-c6b8-4963-8d11-cb141b27e867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "389834b1-1b82-41ba-8cfa-9c009f0446de", "tag": "ea0118de-f9e0-41d5-8073-29cbf9ea684d"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:54.430089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-b6b862b0-8c5e-4325-9a46-bd8a8d94f8cb req-f480e034-c6b8-4963-8d11-cb141b27e867 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:54.430089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-b6b862b0-8c5e-4325-9a46-bd8a8d94f8cb req-f480e034-c6b8-4963-8d11-cb141b27e867 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:54.465331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-b6b862b0-8c5e-4325-9a46-bd8a8d94f8cb req-f480e034-c6b8-4963-8d11-cb141b27e867 service nova] Creating event network-changed:ea0118de-f9e0-41d5-8073-29cbf9ea684d for instance 389834b1-1b82-41ba-8cfa-9c009f0446de on hv-cinder-84902 Jul 11 20:57:54.474176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-b6b862b0-8c5e-4325-9a46-bd8a8d94f8cb req-f480e034-c6b8-4963-8d11-cb141b27e867 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254490 Jul 11 20:57:54.480700 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 35/74] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:54.481841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:54.482545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:54.493936 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:54.494363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:54.495248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:54.495715 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:54.501844 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-476a2c36-f284-4413-9646-ea424096fa49 tempest-VolumesTestJSON-893631829 tempest-VolumesTestJSON-893631829-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.204849 Jul 11 20:57:54.502542 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 40/75] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Jul 11 20:57:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:54.507558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f3917c8d-5425-4048-9858-1fa74b913b52 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:54.509723 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f3917c8d-5425-4048-9858-1fa74b913b52 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:54.551705 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f3917c8d-5425-4048-9858-1fa74b913b52 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:54.552191 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f3917c8d-5425-4048-9858-1fa74b913b52 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:54.553000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f3917c8d-5425-4048-9858-1fa74b913b52 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:54.553428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:54.553540 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f3917c8d-5425-4048-9858-1fa74b913b52 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:55.225991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:55.241976 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:55.249974 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:55.253824 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fe8f76ec-44b4-4df5-a87c-632395bc1bdb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.776548 Jul 11 20:57:55.257019 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 36/76] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:54 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:57:55.271549 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a5836d83-8812-40a4-9dcc-ee781670ec23 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:55.271549 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a5836d83-8812-40a4-9dcc-ee781670ec23 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:55.283955 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a5836d83-8812-40a4-9dcc-ee781670ec23 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:55.292830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a5836d83-8812-40a4-9dcc-ee781670ec23 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:55.293833 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a5836d83-8812-40a4-9dcc-ee781670ec23 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:55.308357 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a5836d83-8812-40a4-9dcc-ee781670ec23 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:55.377294 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f3917c8d-5425-4048-9858-1fa74b913b52 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:55.388324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=100 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:55.406838 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f3917c8d-5425-4048-9858-1fa74b913b52 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.898368 Jul 11 20:57:55.414346 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 41/77] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:54 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:55.427890 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6496e6a1-8410-4bd3-a99f-4dd0c90ab735 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:55.429020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6496e6a1-8410-4bd3-a99f-4dd0c90ab735 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:55.444704 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:55.450796 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6496e6a1-8410-4bd3-a99f-4dd0c90ab735 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:55.457607 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6496e6a1-8410-4bd3-a99f-4dd0c90ab735 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:55.458751 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6496e6a1-8410-4bd3-a99f-4dd0c90ab735 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:55.468875 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6496e6a1-8410-4bd3-a99f-4dd0c90ab735 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:56.219834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a5836d83-8812-40a4-9dcc-ee781670ec23 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:56.233779 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a5836d83-8812-40a4-9dcc-ee781670ec23 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.975389 Jul 11 20:57:56.245122 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 37/78] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:55 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:56.284743 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:56.288629 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:56.298267 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:56.299149 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:56.300765 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:56.301359 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:56.349672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6496e6a1-8410-4bd3-a99f-4dd0c90ab735 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:56.363967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6496e6a1-8410-4bd3-a99f-4dd0c90ab735 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.948076 Jul 11 20:57:56.369749 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 42/79] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:55 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:56.375140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-3feecf1c-ddd2-4f84-9c4e-876c533df04a req-5791055c-a807-4f90-87fd-d1e948e14f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591", "tag": "2414340f-b581-402b-8a8d-335e26258bd9"}, {"name": "network-changed", "server_uuid": "1536f24e-dc7b-4eaf-9b73-32205dbca872", "tag": "6878cb2c-c95a-44b5-8449-0da5fe06d309"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:56.395166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-3feecf1c-ddd2-4f84-9c4e-876c533df04a req-5791055c-a807-4f90-87fd-d1e948e14f4b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:56.395923 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-3feecf1c-ddd2-4f84-9c4e-876c533df04a req-5791055c-a807-4f90-87fd-d1e948e14f4b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:56.423468 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-3feecf1c-ddd2-4f84-9c4e-876c533df04a req-5791055c-a807-4f90-87fd-d1e948e14f4b service nova] Creating event network-changed:2414340f-b581-402b-8a8d-335e26258bd9 for instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 on hv-cinder-84902 Jul 11 20:57:56.424484 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-3feecf1c-ddd2-4f84-9c4e-876c533df04a req-5791055c-a807-4f90-87fd-d1e948e14f4b service nova] Creating event network-changed:6878cb2c-c95a-44b5-8449-0da5fe06d309 for instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 on hv-cinder-84902 Jul 11 20:57:56.425327 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-3feecf1c-ddd2-4f84-9c4e-876c533df04a req-5791055c-a807-4f90-87fd-d1e948e14f4b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118013) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 20:57:56.426731 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ae8771f4-2edc-4ffb-9142-6fe0694d4694 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:56.427338 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ae8771f4-2edc-4ffb-9142-6fe0694d4694 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:56.428340 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ae8771f4-2edc-4ffb-9142-6fe0694d4694 None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:56.428907 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ae8771f4-2edc-4ffb-9142-6fe0694d4694 None None] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:56.441429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.compute.rpcapi [None req-ae8771f4-2edc-4ffb-9142-6fe0694d4694 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 20:57:56.442558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ae8771f4-2edc-4ffb-9142-6fe0694d4694 None None] Releasing lock "compute-rpcapi-router" {{(pid=118013) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 20:57:56.460002 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ae8771f4-2edc-4ffb-9142-6fe0694d4694 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088204 Jul 11 20:57:56.461352 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 43/80] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:56.470922 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ff6307bb-8963-4db7-99e0-f65d53cb4a40 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:56.471963 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ff6307bb-8963-4db7-99e0-f65d53cb4a40 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:56.480271 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff6307bb-8963-4db7-99e0-f65d53cb4a40 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:56.481146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff6307bb-8963-4db7-99e0-f65d53cb4a40 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:56.482059 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff6307bb-8963-4db7-99e0-f65d53cb4a40 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:56.482626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff6307bb-8963-4db7-99e0-f65d53cb4a40 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:56.583357 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:56.592838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:56.594896 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:56.596014 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c00fc6a0-ffda-4baa-8533-0c14fe3b0b94 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.324903 Jul 11 20:57:56.596868 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 38/81] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:56 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:57:56.602502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-f264c11e-4df1-4a69-86a8-bd01a84c245a req-8b6a5ec7-973a-4220-b9fb-81a29521e15d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d87067-da01-484a-86ca-e2ec49f5f15c", "tag": "425242f4-2849-48e1-b30f-b35706e4c781"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:57:56.619101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-f264c11e-4df1-4a69-86a8-bd01a84c245a req-8b6a5ec7-973a-4220-b9fb-81a29521e15d service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:56.619745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-f264c11e-4df1-4a69-86a8-bd01a84c245a req-8b6a5ec7-973a-4220-b9fb-81a29521e15d service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:56.631962 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-f264c11e-4df1-4a69-86a8-bd01a84c245a req-8b6a5ec7-973a-4220-b9fb-81a29521e15d service nova] Creating event network-changed:425242f4-2849-48e1-b30f-b35706e4c781 for instance 88d87067-da01-484a-86ca-e2ec49f5f15c on hv-cinder-84902 Jul 11 20:57:56.637662 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-f264c11e-4df1-4a69-86a8-bd01a84c245a req-8b6a5ec7-973a-4220-b9fb-81a29521e15d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039150 Jul 11 20:57:56.638499 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 39/82] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:57:56.867224 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ff6307bb-8963-4db7-99e0-f65d53cb4a40 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:56.875228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ff6307bb-8963-4db7-99e0-f65d53cb4a40 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.411939 Jul 11 20:57:56.875799 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 44/83] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:56 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:57.251869 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-75278dae-769e-4d88-b2bb-03389204d04d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:57.252725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-75278dae-769e-4d88-b2bb-03389204d04d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:57.260282 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75278dae-769e-4d88-b2bb-03389204d04d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:57.260913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75278dae-769e-4d88-b2bb-03389204d04d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:57.262078 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75278dae-769e-4d88-b2bb-03389204d04d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:57.262275 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75278dae-769e-4d88-b2bb-03389204d04d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:57.388776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fb2ffa63-1487-4ea4-aef3-bc03007f1cb3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:57.389382 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fb2ffa63-1487-4ea4-aef3-bc03007f1cb3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:57.396076 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fb2ffa63-1487-4ea4-aef3-bc03007f1cb3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:57.396739 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fb2ffa63-1487-4ea4-aef3-bc03007f1cb3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:57.397520 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fb2ffa63-1487-4ea4-aef3-bc03007f1cb3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:57.398330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fb2ffa63-1487-4ea4-aef3-bc03007f1cb3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:57.469246 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-75278dae-769e-4d88-b2bb-03389204d04d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:57.478057 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-75278dae-769e-4d88-b2bb-03389204d04d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.230732 Jul 11 20:57:57.480158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 40/84] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:57 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:57:57.591116 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fb2ffa63-1487-4ea4-aef3-bc03007f1cb3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:57.603283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fb2ffa63-1487-4ea4-aef3-bc03007f1cb3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.220891 Jul 11 20:57:57.604360 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 45/85] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:57 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:57:57.614084 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:57.614674 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:57.621788 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:57.622120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:57.623058 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:57.623579 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:57.785351 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:57.794564 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:57.795980 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:57.797751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-696c7e39-f187-4920-a65b-e0b134172287 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.188049 Jul 11 20:57:57.798490 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 41/86] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:57 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:57:57.893299 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0529b16c-ac2d-4b4e-ad3d-e7568fd0d715 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:57.894905 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0529b16c-ac2d-4b4e-ad3d-e7568fd0d715 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:57.913326 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0529b16c-ac2d-4b4e-ad3d-e7568fd0d715 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:57.914720 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0529b16c-ac2d-4b4e-ad3d-e7568fd0d715 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:57.916001 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0529b16c-ac2d-4b4e-ad3d-e7568fd0d715 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:57.918871 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0529b16c-ac2d-4b4e-ad3d-e7568fd0d715 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:58.068824 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0529b16c-ac2d-4b4e-ad3d-e7568fd0d715 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:58.078149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0529b16c-ac2d-4b4e-ad3d-e7568fd0d715 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.189856 Jul 11 20:57:58.080901 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 46/87] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:57 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:58.499028 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f6f6abc7-b99c-4a9f-979d-b71c0ef327b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:58.501273 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f6f6abc7-b99c-4a9f-979d-b71c0ef327b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:58.511742 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f6f6abc7-b99c-4a9f-979d-b71c0ef327b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:58.513000 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f6f6abc7-b99c-4a9f-979d-b71c0ef327b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:58.521717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f6f6abc7-b99c-4a9f-979d-b71c0ef327b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:58.522354 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f6f6abc7-b99c-4a9f-979d-b71c0ef327b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:58.622887 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-18f704a7-2d9d-4de4-bce4-b99e9a2ffea6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:58.623501 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-18f704a7-2d9d-4de4-bce4-b99e9a2ffea6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:58.633478 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-18f704a7-2d9d-4de4-bce4-b99e9a2ffea6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:58.633930 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-18f704a7-2d9d-4de4-bce4-b99e9a2ffea6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:58.638635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-18f704a7-2d9d-4de4-bce4-b99e9a2ffea6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:58.639094 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-18f704a7-2d9d-4de4-bce4-b99e9a2ffea6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:58.752251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f6f6abc7-b99c-4a9f-979d-b71c0ef327b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:58.764372 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f6f6abc7-b99c-4a9f-979d-b71c0ef327b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.271306 Jul 11 20:57:58.766637 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 42/88] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:58 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:58.819658 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:58.819922 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:58.834405 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:58.834907 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:58.835676 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:58.836125 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:58.885786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-18f704a7-2d9d-4de4-bce4-b99e9a2ffea6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:58.905191 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-18f704a7-2d9d-4de4-bce4-b99e9a2ffea6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.286099 Jul 11 20:57:58.905788 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 47/89] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:58 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:59.051073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:59.064426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:59.066670 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:59.068176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-52fce175-bfc1-49ed-9f4f-5b6ba2bb6a44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.255524 Jul 11 20:57:59.069085 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 43/90] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:57:58 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 20:57:59.097959 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e6d4b563-0703-4899-b17f-c7d902b7ac16 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:59.098575 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e6d4b563-0703-4899-b17f-c7d902b7ac16 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:59.104858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e6d4b563-0703-4899-b17f-c7d902b7ac16 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:59.105306 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e6d4b563-0703-4899-b17f-c7d902b7ac16 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:59.106077 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e6d4b563-0703-4899-b17f-c7d902b7ac16 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:59.106511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e6d4b563-0703-4899-b17f-c7d902b7ac16 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:59.304440 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e6d4b563-0703-4899-b17f-c7d902b7ac16 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:59.314123 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e6d4b563-0703-4899-b17f-c7d902b7ac16 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.220293 Jul 11 20:57:59.314716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 48/91] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:59 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:57:59.783807 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0e81ce38-1ebd-4b7d-8dca-e81555360834 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:59.785052 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0e81ce38-1ebd-4b7d-8dca-e81555360834 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:59.792471 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0e81ce38-1ebd-4b7d-8dca-e81555360834 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:59.793046 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0e81ce38-1ebd-4b7d-8dca-e81555360834 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:59.793912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0e81ce38-1ebd-4b7d-8dca-e81555360834 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:59.794440 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0e81ce38-1ebd-4b7d-8dca-e81555360834 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:59.926102 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d5a40531-0df5-43d7-ba2b-383fb1c1cebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:57:59.926902 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d5a40531-0df5-43d7-ba2b-383fb1c1cebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:57:59.934250 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d5a40531-0df5-43d7-ba2b-383fb1c1cebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:59.935073 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d5a40531-0df5-43d7-ba2b-383fb1c1cebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:59.936157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d5a40531-0df5-43d7-ba2b-383fb1c1cebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:57:59.936724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d5a40531-0df5-43d7-ba2b-383fb1c1cebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:57:59.950997 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0e81ce38-1ebd-4b7d-8dca-e81555360834 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:57:59.960213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0e81ce38-1ebd-4b7d-8dca-e81555360834 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.180222 Jul 11 20:57:59.962119 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 44/92] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:59 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:00.089490 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:00.089490 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:00.095407 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:00.095861 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:00.099254 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:00.099607 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:00.133662 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d5a40531-0df5-43d7-ba2b-383fb1c1cebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:00.141012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d5a40531-0df5-43d7-ba2b-383fb1c1cebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.222068 Jul 11 20:58:00.141628 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 49/93] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:57:59 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:00.286608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:00.308088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:00.313235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:00.314408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-561d8979-7863-4fc5-8fa7-e3396758f9d4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.231519 Jul 11 20:58:00.315472 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 45/94] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:00 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 20:58:00.332965 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7576012b-b66b-473d-8aa2-d5b71ba0a510 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:00.333693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7576012b-b66b-473d-8aa2-d5b71ba0a510 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:00.340183 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7576012b-b66b-473d-8aa2-d5b71ba0a510 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:00.341088 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7576012b-b66b-473d-8aa2-d5b71ba0a510 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:00.342058 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7576012b-b66b-473d-8aa2-d5b71ba0a510 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:00.342704 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7576012b-b66b-473d-8aa2-d5b71ba0a510 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:00.507852 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7576012b-b66b-473d-8aa2-d5b71ba0a510 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:00.516393 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7576012b-b66b-473d-8aa2-d5b71ba0a510 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.189538 Jul 11 20:58:00.517028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 50/95] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:00 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:00.977739 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-271f186f-b7d6-4918-bd15-f3cddfd8e721 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:00.978492 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-271f186f-b7d6-4918-bd15-f3cddfd8e721 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:00.986427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-271f186f-b7d6-4918-bd15-f3cddfd8e721 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:00.987833 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-271f186f-b7d6-4918-bd15-f3cddfd8e721 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:00.989129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-271f186f-b7d6-4918-bd15-f3cddfd8e721 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:00.990118 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-271f186f-b7d6-4918-bd15-f3cddfd8e721 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:01.144463 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-271f186f-b7d6-4918-bd15-f3cddfd8e721 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:01.157922 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-271f186f-b7d6-4918-bd15-f3cddfd8e721 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.183721 Jul 11 20:58:01.159449 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2f5d518b-5797-4ddd-9957-79b034fb1795 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:01.160222 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 46/96] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:00 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:01.170593 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2f5d518b-5797-4ddd-9957-79b034fb1795 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:01.177491 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f5d518b-5797-4ddd-9957-79b034fb1795 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:01.178089 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f5d518b-5797-4ddd-9957-79b034fb1795 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:01.179050 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f5d518b-5797-4ddd-9957-79b034fb1795 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:01.180062 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f5d518b-5797-4ddd-9957-79b034fb1795 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:01.334260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:01.335018 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:01.345705 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:01.346159 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:01.347006 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:01.347616 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:01.383812 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2f5d518b-5797-4ddd-9957-79b034fb1795 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:01.395404 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2f5d518b-5797-4ddd-9957-79b034fb1795 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.240889 Jul 11 20:58:01.396375 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 51/97] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:01 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:01.532769 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4675d1e5-2331-49ef-a4e9-146c9a75d78d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:01.534383 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4675d1e5-2331-49ef-a4e9-146c9a75d78d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:01.537460 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:01.543565 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4675d1e5-2331-49ef-a4e9-146c9a75d78d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:01.545309 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4675d1e5-2331-49ef-a4e9-146c9a75d78d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:01.546884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4675d1e5-2331-49ef-a4e9-146c9a75d78d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:01.547643 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4675d1e5-2331-49ef-a4e9-146c9a75d78d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:01.550175 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:01.551616 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:01.553329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d8b3f8da-0e2a-42e6-a33a-6bd721c29ce9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.224074 Jul 11 20:58:01.554092 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 47/98] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:01 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:02.131180 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4675d1e5-2331-49ef-a4e9-146c9a75d78d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:02.138855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4675d1e5-2331-49ef-a4e9-146c9a75d78d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.610152 Jul 11 20:58:02.139699 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 52/99] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:01 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:02.176895 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-dc42a19a-0f14-4ee8-a18c-6cde68572b09 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:02.177826 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-dc42a19a-0f14-4ee8-a18c-6cde68572b09 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:02.184813 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dc42a19a-0f14-4ee8-a18c-6cde68572b09 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:02.185259 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dc42a19a-0f14-4ee8-a18c-6cde68572b09 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:02.186053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dc42a19a-0f14-4ee8-a18c-6cde68572b09 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:02.186486 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dc42a19a-0f14-4ee8-a18c-6cde68572b09 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:02.368304 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-dc42a19a-0f14-4ee8-a18c-6cde68572b09 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:02.376060 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-dc42a19a-0f14-4ee8-a18c-6cde68572b09 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.203796 Jul 11 20:58:02.376695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 48/100] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:02 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:02.413032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a6fb2b09-12cb-4444-8253-931400289716 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:02.413635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a6fb2b09-12cb-4444-8253-931400289716 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:02.420159 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6fb2b09-12cb-4444-8253-931400289716 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:02.420846 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6fb2b09-12cb-4444-8253-931400289716 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:02.421673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6fb2b09-12cb-4444-8253-931400289716 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:02.422132 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6fb2b09-12cb-4444-8253-931400289716 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:02.584568 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a6fb2b09-12cb-4444-8253-931400289716 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:02.589430 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:02.590150 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:02.593443 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a6fb2b09-12cb-4444-8253-931400289716 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.184404 Jul 11 20:58:02.594026 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 53/101] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:02 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:02.596978 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:02.597730 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:02.599492 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:02.600608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:02.738606 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:02.753478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:02.756125 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:02.757345 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-aff34115-2a69-434c-9bb1-86c121030333 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.171779 Jul 11 20:58:02.757911 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 49/102] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:02 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:03.156058 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-579f6ea7-365d-40ca-90fd-aa61dc971b1f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:03.156724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-579f6ea7-365d-40ca-90fd-aa61dc971b1f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:03.162951 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-579f6ea7-365d-40ca-90fd-aa61dc971b1f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:03.163627 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-579f6ea7-365d-40ca-90fd-aa61dc971b1f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:03.164429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-579f6ea7-365d-40ca-90fd-aa61dc971b1f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:03.165029 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-579f6ea7-365d-40ca-90fd-aa61dc971b1f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:03.315820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-579f6ea7-365d-40ca-90fd-aa61dc971b1f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:03.325037 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-579f6ea7-365d-40ca-90fd-aa61dc971b1f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.173729 Jul 11 20:58:03.326249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 54/103] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:03 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:03.391948 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-18c71b0f-ab57-4df8-a928-38065b64e94a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:03.392584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-18c71b0f-ab57-4df8-a928-38065b64e94a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:03.398781 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-18c71b0f-ab57-4df8-a928-38065b64e94a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:03.399222 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-18c71b0f-ab57-4df8-a928-38065b64e94a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:03.399979 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-18c71b0f-ab57-4df8-a928-38065b64e94a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:03.400437 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-18c71b0f-ab57-4df8-a928-38065b64e94a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:03.536831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-18c71b0f-ab57-4df8-a928-38065b64e94a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:03.544713 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-18c71b0f-ab57-4df8-a928-38065b64e94a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.156555 Jul 11 20:58:03.545315 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 50/104] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:03 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:03.610808 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1dbaba68-f01b-4ab4-9f41-0cad7145149e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:03.611394 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1dbaba68-f01b-4ab4-9f41-0cad7145149e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:03.618451 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1dbaba68-f01b-4ab4-9f41-0cad7145149e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:03.618980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1dbaba68-f01b-4ab4-9f41-0cad7145149e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:03.619833 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1dbaba68-f01b-4ab4-9f41-0cad7145149e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:03.620351 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1dbaba68-f01b-4ab4-9f41-0cad7145149e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:03.752141 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1dbaba68-f01b-4ab4-9f41-0cad7145149e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:03.766063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1dbaba68-f01b-4ab4-9f41-0cad7145149e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.159046 Jul 11 20:58:03.767136 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 55/105] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:03 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:03.775593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:03.776347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:03.782561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:03.782987 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:03.783751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:03.784239 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:03.924682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:03.935052 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:03.936670 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:03.937869 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-05799b73-1a52-4693-b3be-adaba5e021f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.166171 Jul 11 20:58:03.938508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 51/106] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:03 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:04.344208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-504f0d18-d34d-43b9-a468-4cfece172e4a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:04.344889 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-504f0d18-d34d-43b9-a468-4cfece172e4a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:04.352559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-504f0d18-d34d-43b9-a468-4cfece172e4a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:04.353005 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-504f0d18-d34d-43b9-a468-4cfece172e4a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:04.353772 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-504f0d18-d34d-43b9-a468-4cfece172e4a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:04.354218 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-504f0d18-d34d-43b9-a468-4cfece172e4a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:04.496822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-504f0d18-d34d-43b9-a468-4cfece172e4a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:04.504507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-504f0d18-d34d-43b9-a468-4cfece172e4a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.166075 Jul 11 20:58:04.505084 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 56/107] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:04 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:04.562932 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d1fa9a45-5694-4909-9122-e88106eb7b7c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:04.563570 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d1fa9a45-5694-4909-9122-e88106eb7b7c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:04.565581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:04.571414 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d1fa9a45-5694-4909-9122-e88106eb7b7c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:04.571876 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d1fa9a45-5694-4909-9122-e88106eb7b7c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:04.572647 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d1fa9a45-5694-4909-9122-e88106eb7b7c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:04.573071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d1fa9a45-5694-4909-9122-e88106eb7b7c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:04.706948 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d1fa9a45-5694-4909-9122-e88106eb7b7c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:04.714580 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d1fa9a45-5694-4909-9122-e88106eb7b7c tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.155523 Jul 11 20:58:04.715144 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 52/108] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:04 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:04.787208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5c650841-4a87-4f48-885b-aab07d9acdb9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:04.788201 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5c650841-4a87-4f48-885b-aab07d9acdb9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:04.798903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c650841-4a87-4f48-885b-aab07d9acdb9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:04.800028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c650841-4a87-4f48-885b-aab07d9acdb9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:04.801429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c650841-4a87-4f48-885b-aab07d9acdb9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:04.802116 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c650841-4a87-4f48-885b-aab07d9acdb9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:04.948198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5c650841-4a87-4f48-885b-aab07d9acdb9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:04.954859 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:04.955546 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:04.955642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5c650841-4a87-4f48-885b-aab07d9acdb9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.175334 Jul 11 20:58:04.956858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 57/109] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:04 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:04.962082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:04.962601 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:04.963473 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:04.963901 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:05.097753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:05.101209 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:05.106671 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:05.108233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:05.109340 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cec36935-4857-43b0-a420-e9e9a7862c27 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.158305 Jul 11 20:58:05.109898 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 53/110] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:04 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:05.521221 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-de26f8de-0a47-4831-a016-41d82c79d249 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:05.521847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-de26f8de-0a47-4831-a016-41d82c79d249 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:05.528375 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de26f8de-0a47-4831-a016-41d82c79d249 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:05.528817 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de26f8de-0a47-4831-a016-41d82c79d249 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:05.529668 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de26f8de-0a47-4831-a016-41d82c79d249 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:05.530118 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de26f8de-0a47-4831-a016-41d82c79d249 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:05.731637 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6e007e4f-6c23-4107-9883-8557cb2dfc14 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:05.732878 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6e007e4f-6c23-4107-9883-8557cb2dfc14 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:05.739406 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e007e4f-6c23-4107-9883-8557cb2dfc14 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:05.739819 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e007e4f-6c23-4107-9883-8557cb2dfc14 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:05.740853 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e007e4f-6c23-4107-9883-8557cb2dfc14 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:05.741263 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e007e4f-6c23-4107-9883-8557cb2dfc14 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:05.747722 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-de26f8de-0a47-4831-a016-41d82c79d249 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:05.751958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=100 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:05.758667 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-de26f8de-0a47-4831-a016-41d82c79d249 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.242205 Jul 11 20:58:05.760514 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 58/111] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:05 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:05.899231 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6e007e4f-6c23-4107-9883-8557cb2dfc14 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:05.908403 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6e007e4f-6c23-4107-9883-8557cb2dfc14 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.181088 Jul 11 20:58:05.909377 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 54/112] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:05 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:05.973136 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-de92e4d0-b67d-466a-8519-ea73d45f5424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:05.974285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-de92e4d0-b67d-466a-8519-ea73d45f5424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:05.984128 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de92e4d0-b67d-466a-8519-ea73d45f5424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:05.985216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de92e4d0-b67d-466a-8519-ea73d45f5424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:05.986385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de92e4d0-b67d-466a-8519-ea73d45f5424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:05.986982 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de92e4d0-b67d-466a-8519-ea73d45f5424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:06.127072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:06.127702 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:06.134772 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:06.135254 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:06.136001 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:06.136511 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:06.147350 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-de92e4d0-b67d-466a-8519-ea73d45f5424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:06.155299 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-de92e4d0-b67d-466a-8519-ea73d45f5424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.186852 Jul 11 20:58:06.155871 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 59/113] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:05 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:06.275237 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:06.284753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:06.286427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:06.287539 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ab308e24-2173-4092-af44-667df282a3b6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.164460 Jul 11 20:58:06.288213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 55/114] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:06 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:06.777198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c1963932-d78c-4c4b-9a3a-4341c64d9fa2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:06.778017 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c1963932-d78c-4c4b-9a3a-4341c64d9fa2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:06.780000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:06.785683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c1963932-d78c-4c4b-9a3a-4341c64d9fa2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:06.786131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c1963932-d78c-4c4b-9a3a-4341c64d9fa2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:06.786898 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c1963932-d78c-4c4b-9a3a-4341c64d9fa2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:06.787332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c1963932-d78c-4c4b-9a3a-4341c64d9fa2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:06.926027 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ae78caae-ac29-451d-9433-8e81c36720df tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:06.926551 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c1963932-d78c-4c4b-9a3a-4341c64d9fa2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:06.927328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ae78caae-ac29-451d-9433-8e81c36720df tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:06.934617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ae78caae-ac29-451d-9433-8e81c36720df tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:06.935266 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ae78caae-ac29-451d-9433-8e81c36720df tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:06.936204 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ae78caae-ac29-451d-9433-8e81c36720df tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:06.936966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ae78caae-ac29-451d-9433-8e81c36720df tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:06.939154 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c1963932-d78c-4c4b-9a3a-4341c64d9fa2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.165839 Jul 11 20:58:06.954752 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 60/115] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:06 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:07.141998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ae78caae-ac29-451d-9433-8e81c36720df tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:07.150798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ae78caae-ac29-451d-9433-8e81c36720df tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.229308 Jul 11 20:58:07.160723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 56/116] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:06 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:07.172192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8317cc9a-1a78-4c5c-9a79-c9fb85d21445 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:07.173357 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8317cc9a-1a78-4c5c-9a79-c9fb85d21445 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:07.179735 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8317cc9a-1a78-4c5c-9a79-c9fb85d21445 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:07.180245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8317cc9a-1a78-4c5c-9a79-c9fb85d21445 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:07.182173 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8317cc9a-1a78-4c5c-9a79-c9fb85d21445 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:07.182699 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8317cc9a-1a78-4c5c-9a79-c9fb85d21445 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:07.308245 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:07.308971 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:07.329680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:07.335341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:07.336302 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:07.336813 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:07.362272 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8317cc9a-1a78-4c5c-9a79-c9fb85d21445 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:07.370219 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8317cc9a-1a78-4c5c-9a79-c9fb85d21445 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.202208 Jul 11 20:58:07.372353 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 61/117] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:07 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:07.533725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:07.550769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:07.552358 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:07.553511 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9db77253-0a5b-42a9-a0d9-9eefd8a20432 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.251069 Jul 11 20:58:07.554391 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 57/118] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:07 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:07.956851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a33661ed-25ff-4833-9d01-e3d312137c10 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:07.958283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a33661ed-25ff-4833-9d01-e3d312137c10 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:07.964699 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a33661ed-25ff-4833-9d01-e3d312137c10 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:07.965209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a33661ed-25ff-4833-9d01-e3d312137c10 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:07.966085 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a33661ed-25ff-4833-9d01-e3d312137c10 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:07.966720 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a33661ed-25ff-4833-9d01-e3d312137c10 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:08.108681 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a33661ed-25ff-4833-9d01-e3d312137c10 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:08.118567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a33661ed-25ff-4833-9d01-e3d312137c10 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.166257 Jul 11 20:58:08.128252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 62/119] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:07 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:08.167386 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ef9f0133-f173-4abd-b9ee-8581b38e6f9d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:08.168869 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ef9f0133-f173-4abd-b9ee-8581b38e6f9d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:08.177682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef9f0133-f173-4abd-b9ee-8581b38e6f9d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:08.178621 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef9f0133-f173-4abd-b9ee-8581b38e6f9d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:08.179567 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef9f0133-f173-4abd-b9ee-8581b38e6f9d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:08.180130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef9f0133-f173-4abd-b9ee-8581b38e6f9d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:08.354971 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ef9f0133-f173-4abd-b9ee-8581b38e6f9d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:08.362629 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ef9f0133-f173-4abd-b9ee-8581b38e6f9d tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.199423 Jul 11 20:58:08.363245 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 58/120] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:08 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:08.388793 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fff8e7e2-61d3-4596-9e2c-b17317cc3c5b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:08.389986 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fff8e7e2-61d3-4596-9e2c-b17317cc3c5b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:08.396975 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fff8e7e2-61d3-4596-9e2c-b17317cc3c5b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:08.397740 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fff8e7e2-61d3-4596-9e2c-b17317cc3c5b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:08.398692 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fff8e7e2-61d3-4596-9e2c-b17317cc3c5b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:08.399292 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fff8e7e2-61d3-4596-9e2c-b17317cc3c5b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:08.547632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fff8e7e2-61d3-4596-9e2c-b17317cc3c5b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:08.565152 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fff8e7e2-61d3-4596-9e2c-b17317cc3c5b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.171664 Jul 11 20:58:08.567168 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 63/121] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:08 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:08.580905 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:08.582218 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:08.589683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:08.590278 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:08.591047 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:08.591477 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:08.800148 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:08.818859 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:08.821698 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:08.824016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ca60b95f-feaa-4ed1-9ef3-89f34054afbc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.247849 Jul 11 20:58:08.837350 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 59/122] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:08 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:09.136517 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4248eb9e-5cab-488d-b241-cf7fea4d4e49 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:09.137265 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4248eb9e-5cab-488d-b241-cf7fea4d4e49 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:09.145290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4248eb9e-5cab-488d-b241-cf7fea4d4e49 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:09.146062 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4248eb9e-5cab-488d-b241-cf7fea4d4e49 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:09.146875 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4248eb9e-5cab-488d-b241-cf7fea4d4e49 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:09.148801 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4248eb9e-5cab-488d-b241-cf7fea4d4e49 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:09.354923 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4248eb9e-5cab-488d-b241-cf7fea4d4e49 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:09.360462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4248eb9e-5cab-488d-b241-cf7fea4d4e49 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.229267 Jul 11 20:58:09.361042 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 64/123] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:09 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:09.380158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-aef4a583-259e-4a56-8b09-b9b5616ec146 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:09.380994 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-aef4a583-259e-4a56-8b09-b9b5616ec146 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:09.387426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aef4a583-259e-4a56-8b09-b9b5616ec146 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:09.387942 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aef4a583-259e-4a56-8b09-b9b5616ec146 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:09.388986 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aef4a583-259e-4a56-8b09-b9b5616ec146 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:09.389584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aef4a583-259e-4a56-8b09-b9b5616ec146 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:09.558476 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-aef4a583-259e-4a56-8b09-b9b5616ec146 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:09.566933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-aef4a583-259e-4a56-8b09-b9b5616ec146 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.191314 Jul 11 20:58:09.568263 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 60/124] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:09 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:09.582972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3dab8744-d830-48c5-9b48-c7d1cef62385 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:09.584385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3dab8744-d830-48c5-9b48-c7d1cef62385 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:09.592540 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3dab8744-d830-48c5-9b48-c7d1cef62385 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:09.593015 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3dab8744-d830-48c5-9b48-c7d1cef62385 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:09.594081 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3dab8744-d830-48c5-9b48-c7d1cef62385 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:09.594570 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3dab8744-d830-48c5-9b48-c7d1cef62385 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:09.742649 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3dab8744-d830-48c5-9b48-c7d1cef62385 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:09.750143 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3dab8744-d830-48c5-9b48-c7d1cef62385 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.171044 Jul 11 20:58:09.761267 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 65/125] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:09 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:09.845622 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:09.846224 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:09.853917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:09.854399 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:09.855343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:09.855825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:10.007036 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:10.016680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:10.018792 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:10.020254 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-952a0caf-bd46-48b0-bf33-eaf63188358d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.178541 Jul 11 20:58:10.020707 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 61/126] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:09 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:10.383206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e740e0df-7832-40cd-abf8-add61b1316c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:10.383911 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e740e0df-7832-40cd-abf8-add61b1316c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:10.392224 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e740e0df-7832-40cd-abf8-add61b1316c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:10.393024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e740e0df-7832-40cd-abf8-add61b1316c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:10.395048 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e740e0df-7832-40cd-abf8-add61b1316c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:10.395917 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e740e0df-7832-40cd-abf8-add61b1316c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:10.585613 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8fa91439-237a-48ac-aed8-f2841b8bc779 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:10.586327 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8fa91439-237a-48ac-aed8-f2841b8bc779 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:10.593027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e740e0df-7832-40cd-abf8-add61b1316c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:10.598795 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fa91439-237a-48ac-aed8-f2841b8bc779 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:10.599520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fa91439-237a-48ac-aed8-f2841b8bc779 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:10.601433 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fa91439-237a-48ac-aed8-f2841b8bc779 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:10.603343 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e740e0df-7832-40cd-abf8-add61b1316c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.229312 Jul 11 20:58:10.603762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fa91439-237a-48ac-aed8-f2841b8bc779 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:10.615344 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 66/127] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:10 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:10.773623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-58ca8093-9951-45a8-9525-8a17aade6953 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:10.774232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-58ca8093-9951-45a8-9525-8a17aade6953 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:10.777250 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8fa91439-237a-48ac-aed8-f2841b8bc779 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:10.790745 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58ca8093-9951-45a8-9525-8a17aade6953 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:10.791618 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58ca8093-9951-45a8-9525-8a17aade6953 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:10.792158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8fa91439-237a-48ac-aed8-f2841b8bc779 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.211673 Jul 11 20:58:10.792818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58ca8093-9951-45a8-9525-8a17aade6953 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:10.792940 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 62/128] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:10 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:10.793252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58ca8093-9951-45a8-9525-8a17aade6953 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:11.041052 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:11.041843 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:11.059255 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:11.060883 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:11.062064 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:11.063903 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:11.248703 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-58ca8093-9951-45a8-9525-8a17aade6953 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:11.271126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-58ca8093-9951-45a8-9525-8a17aade6953 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.506707 Jul 11 20:58:11.271727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 67/129] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:10 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:11.447169 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:11.459460 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:11.461319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:11.462650 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-750a2b94-9eb5-4672-85b1-b5d1f070b65a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.427891 Jul 11 20:58:11.464395 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 63/130] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:11 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:11.622285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8d7dd115-8b96-4774-9af3-ee5560e982bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:11.623850 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8d7dd115-8b96-4774-9af3-ee5560e982bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:11.633401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8d7dd115-8b96-4774-9af3-ee5560e982bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:11.635368 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8d7dd115-8b96-4774-9af3-ee5560e982bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:11.636585 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8d7dd115-8b96-4774-9af3-ee5560e982bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:11.637468 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8d7dd115-8b96-4774-9af3-ee5560e982bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:11.809464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-85e9ec54-1ca7-485d-9f32-f0221ca9b0be tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:11.809977 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-85e9ec54-1ca7-485d-9f32-f0221ca9b0be tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:11.823792 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-85e9ec54-1ca7-485d-9f32-f0221ca9b0be tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:11.824262 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-85e9ec54-1ca7-485d-9f32-f0221ca9b0be tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:11.828071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-85e9ec54-1ca7-485d-9f32-f0221ca9b0be tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:11.828745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-85e9ec54-1ca7-485d-9f32-f0221ca9b0be tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:11.868778 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8d7dd115-8b96-4774-9af3-ee5560e982bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:11.882980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8d7dd115-8b96-4774-9af3-ee5560e982bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.265170 Jul 11 20:58:11.883576 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 68/131] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:11 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:12.214798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-85e9ec54-1ca7-485d-9f32-f0221ca9b0be tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:12.224212 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-85e9ec54-1ca7-485d-9f32-f0221ca9b0be tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.418904 Jul 11 20:58:12.228269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 64/132] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:11 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:12.296609 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f36c9a59-17d1-4806-bffa-4e41cfe82373 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:12.297539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f36c9a59-17d1-4806-bffa-4e41cfe82373 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:12.305760 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f36c9a59-17d1-4806-bffa-4e41cfe82373 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:12.306211 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f36c9a59-17d1-4806-bffa-4e41cfe82373 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:12.307347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f36c9a59-17d1-4806-bffa-4e41cfe82373 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:12.307974 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f36c9a59-17d1-4806-bffa-4e41cfe82373 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:12.450641 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f36c9a59-17d1-4806-bffa-4e41cfe82373 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:12.459528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f36c9a59-17d1-4806-bffa-4e41cfe82373 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.175522 Jul 11 20:58:12.460363 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 69/133] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:12 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:12.481895 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:12.483127 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:12.490317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:12.490920 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:12.491853 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:12.492449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:12.646098 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:12.658281 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:12.660408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:12.662092 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0946514d-9ac5-4e10-9eda-33ba29ff87e0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.184946 Jul 11 20:58:12.672896 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 65/134] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:12 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:12.907853 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8fac0241-db19-4d22-b618-953a64442b44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:12.909563 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8fac0241-db19-4d22-b618-953a64442b44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:12.916232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8fac0241-db19-4d22-b618-953a64442b44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:12.916999 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8fac0241-db19-4d22-b618-953a64442b44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:12.918429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8fac0241-db19-4d22-b618-953a64442b44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:12.919072 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8fac0241-db19-4d22-b618-953a64442b44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:13.085725 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8fac0241-db19-4d22-b618-953a64442b44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:13.094895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8fac0241-db19-4d22-b618-953a64442b44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.198292 Jul 11 20:58:13.095708 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 70/135] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:12 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:13.243365 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-073b08d8-11ed-4ac7-a286-7bdc811fe50e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:13.244687 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-073b08d8-11ed-4ac7-a286-7bdc811fe50e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:13.253769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-073b08d8-11ed-4ac7-a286-7bdc811fe50e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:13.254245 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-073b08d8-11ed-4ac7-a286-7bdc811fe50e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:13.255175 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-073b08d8-11ed-4ac7-a286-7bdc811fe50e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:13.255759 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-073b08d8-11ed-4ac7-a286-7bdc811fe50e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:13.448655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-073b08d8-11ed-4ac7-a286-7bdc811fe50e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:13.458248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-073b08d8-11ed-4ac7-a286-7bdc811fe50e tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.219225 Jul 11 20:58:13.461448 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 66/136] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:13 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:13.477499 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-390a3cf2-5e3b-46d0-87cd-e093d90c6bc1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:13.478294 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-390a3cf2-5e3b-46d0-87cd-e093d90c6bc1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:13.484522 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-390a3cf2-5e3b-46d0-87cd-e093d90c6bc1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:13.485257 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-390a3cf2-5e3b-46d0-87cd-e093d90c6bc1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:13.486229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-390a3cf2-5e3b-46d0-87cd-e093d90c6bc1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:13.486910 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-390a3cf2-5e3b-46d0-87cd-e093d90c6bc1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:13.683500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:13.684388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:13.703672 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:13.704145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:13.704276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-390a3cf2-5e3b-46d0-87cd-e093d90c6bc1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:13.704909 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:13.705341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:13.722268 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-390a3cf2-5e3b-46d0-87cd-e093d90c6bc1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.248981 Jul 11 20:58:13.723384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 71/137] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:13 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:13.876495 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:13.888607 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:13.890584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:13.892338 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-78d2d530-db54-4305-8b3a-03266227a693 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.215176 Jul 11 20:58:13.893124 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 67/138] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:13 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 20:58:14.114266 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fc6ace4c-4245-44bd-b9d5-aacbabc42f08 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:14.115126 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fc6ace4c-4245-44bd-b9d5-aacbabc42f08 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:14.124395 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fc6ace4c-4245-44bd-b9d5-aacbabc42f08 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:14.125213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fc6ace4c-4245-44bd-b9d5-aacbabc42f08 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:14.126134 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fc6ace4c-4245-44bd-b9d5-aacbabc42f08 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:14.127933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fc6ace4c-4245-44bd-b9d5-aacbabc42f08 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:14.225603 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-fabdba1f-8772-4001-9085-a30e5f69f549 req-8b4f93df-461a-4d55-a6f8-3daf1cee2b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591", "name": "network-vif-plugged", "status": "completed", "tag": "2414340f-b581-402b-8a8d-335e26258bd9"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:14.235544 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-fabdba1f-8772-4001-9085-a30e5f69f549 req-8b4f93df-461a-4d55-a6f8-3daf1cee2b80 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:14.236289 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-fabdba1f-8772-4001-9085-a30e5f69f549 req-8b4f93df-461a-4d55-a6f8-3daf1cee2b80 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:14.260155 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-fabdba1f-8772-4001-9085-a30e5f69f549 req-8b4f93df-461a-4d55-a6f8-3daf1cee2b80 service nova] Creating event network-vif-plugged:2414340f-b581-402b-8a8d-335e26258bd9 for instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 on hv-cinder-84902 Jul 11 20:58:14.267809 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-fabdba1f-8772-4001-9085-a30e5f69f549 req-8b4f93df-461a-4d55-a6f8-3daf1cee2b80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283502 Jul 11 20:58:14.268933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 72/139] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:58:14.318872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fc6ace4c-4245-44bd-b9d5-aacbabc42f08 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:14.331649 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fc6ace4c-4245-44bd-b9d5-aacbabc42f08 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.222719 Jul 11 20:58:14.334082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 68/140] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:14 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:14.475504 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4b81fa01-f6a1-4e14-8dd0-e9885011f260 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:14.476455 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4b81fa01-f6a1-4e14-8dd0-e9885011f260 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:14.483966 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4b81fa01-f6a1-4e14-8dd0-e9885011f260 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:14.485548 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4b81fa01-f6a1-4e14-8dd0-e9885011f260 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:14.487164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4b81fa01-f6a1-4e14-8dd0-e9885011f260 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:14.489373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4b81fa01-f6a1-4e14-8dd0-e9885011f260 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:14.637563 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4b81fa01-f6a1-4e14-8dd0-e9885011f260 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:14.647438 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4b81fa01-f6a1-4e14-8dd0-e9885011f260 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.175985 Jul 11 20:58:14.648541 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 73/141] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:14 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:14.740235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bc6a4812-d843-4b19-a8fc-1d4f9bce8424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:14.740906 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bc6a4812-d843-4b19-a8fc-1d4f9bce8424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:14.747960 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc6a4812-d843-4b19-a8fc-1d4f9bce8424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:14.748628 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc6a4812-d843-4b19-a8fc-1d4f9bce8424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:14.749991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc6a4812-d843-4b19-a8fc-1d4f9bce8424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:14.750424 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc6a4812-d843-4b19-a8fc-1d4f9bce8424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:14.912216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:14.913280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:14.916685 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bc6a4812-d843-4b19-a8fc-1d4f9bce8424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:14.921241 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:14.921815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:14.922800 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:14.923661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:14.926808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bc6a4812-d843-4b19-a8fc-1d4f9bce8424 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.190966 Jul 11 20:58:14.936339 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 69/142] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:14 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:15.157797 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:15.167066 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:15.168518 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:15.169634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0dc1f470-7a46-4d1f-a059-a27ad48d869a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.262315 Jul 11 20:58:15.170445 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 74/143] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:14 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 20:58:15.351427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8d1d90f1-17c0-4763-a378-4898706dae42 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:15.352729 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8d1d90f1-17c0-4763-a378-4898706dae42 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:15.359071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d1d90f1-17c0-4763-a378-4898706dae42 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:15.360248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d1d90f1-17c0-4763-a378-4898706dae42 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:15.361001 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d1d90f1-17c0-4763-a378-4898706dae42 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:15.361743 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d1d90f1-17c0-4763-a378-4898706dae42 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:15.381776 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:15.510452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8d1d90f1-17c0-4763-a378-4898706dae42 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:15.518553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8d1d90f1-17c0-4763-a378-4898706dae42 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.171032 Jul 11 20:58:15.519351 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 70/144] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:15 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:15.666264 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a2969e98-629d-45ce-b7d5-889fbb5effb1 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:15.666874 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a2969e98-629d-45ce-b7d5-889fbb5effb1 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:15.674044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a2969e98-629d-45ce-b7d5-889fbb5effb1 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:15.674566 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a2969e98-629d-45ce-b7d5-889fbb5effb1 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:15.675941 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a2969e98-629d-45ce-b7d5-889fbb5effb1 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:15.676404 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a2969e98-629d-45ce-b7d5-889fbb5effb1 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:15.825975 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a2969e98-629d-45ce-b7d5-889fbb5effb1 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:15.835292 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a2969e98-629d-45ce-b7d5-889fbb5effb1 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.174152 Jul 11 20:58:15.835887 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 75/145] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:15 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:15.948806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-85ef1337-7095-4fd0-9cfd-1ac237114d4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:15.949890 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-85ef1337-7095-4fd0-9cfd-1ac237114d4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:15.957442 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-85ef1337-7095-4fd0-9cfd-1ac237114d4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:15.957898 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-85ef1337-7095-4fd0-9cfd-1ac237114d4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:15.959565 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-85ef1337-7095-4fd0-9cfd-1ac237114d4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:15.960194 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-85ef1337-7095-4fd0-9cfd-1ac237114d4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:16.096569 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-85ef1337-7095-4fd0-9cfd-1ac237114d4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:16.104744 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-85ef1337-7095-4fd0-9cfd-1ac237114d4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.164694 Jul 11 20:58:16.105314 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 71/146] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:15 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:16.188465 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:16.189097 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:16.195527 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:16.195962 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:16.196770 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:16.197394 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:16.201484 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=100 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:16.331756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:16.341944 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:16.343456 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:16.344589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a19c39ca-e922-4d00-b18d-fc604dff7cd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.160125 Jul 11 20:58:16.345149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 76/147] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:16 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:16.534827 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a3d9464d-b2b9-4a9d-94cc-53364de21c07 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:16.535645 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a3d9464d-b2b9-4a9d-94cc-53364de21c07 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:16.541923 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a3d9464d-b2b9-4a9d-94cc-53364de21c07 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:16.542377 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a3d9464d-b2b9-4a9d-94cc-53364de21c07 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:16.543129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a3d9464d-b2b9-4a9d-94cc-53364de21c07 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:16.543558 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a3d9464d-b2b9-4a9d-94cc-53364de21c07 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:16.677282 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a3d9464d-b2b9-4a9d-94cc-53364de21c07 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:16.685768 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a3d9464d-b2b9-4a9d-94cc-53364de21c07 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.154827 Jul 11 20:58:16.686266 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 72/148] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:16 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:16.852674 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9ea53efc-2ffd-461a-a1c2-e1fdf3e640b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:16.853280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9ea53efc-2ffd-461a-a1c2-e1fdf3e640b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:16.859482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9ea53efc-2ffd-461a-a1c2-e1fdf3e640b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:16.860059 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9ea53efc-2ffd-461a-a1c2-e1fdf3e640b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:16.860709 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9ea53efc-2ffd-461a-a1c2-e1fdf3e640b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:16.861121 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9ea53efc-2ffd-461a-a1c2-e1fdf3e640b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:16.999411 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9ea53efc-2ffd-461a-a1c2-e1fdf3e640b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:17.007320 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9ea53efc-2ffd-461a-a1c2-e1fdf3e640b3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.158437 Jul 11 20:58:17.007980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 77/149] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:16 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:17.121096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f1febb1f-684f-41ef-a9c2-9782ffdf6c2f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:17.121690 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f1febb1f-684f-41ef-a9c2-9782ffdf6c2f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:17.129106 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1febb1f-684f-41ef-a9c2-9782ffdf6c2f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:17.129547 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1febb1f-684f-41ef-a9c2-9782ffdf6c2f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:17.130309 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1febb1f-684f-41ef-a9c2-9782ffdf6c2f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:17.130737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1febb1f-684f-41ef-a9c2-9782ffdf6c2f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:17.274025 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f1febb1f-684f-41ef-a9c2-9782ffdf6c2f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:17.281430 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f1febb1f-684f-41ef-a9c2-9782ffdf6c2f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.164378 Jul 11 20:58:17.282035 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 73/150] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:17 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:17.367243 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:17.368007 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:17.377570 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:17.378112 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:17.379157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:17.379653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:17.535758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:17.544048 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:17.545549 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:17.546649 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fa2053f8-9ce0-462d-b73f-2c2b3fd7634c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.186343 Jul 11 20:58:17.547241 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 78/151] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:17 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:17.704383 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1b49c2f8-7929-43c8-8e84-30508f44c6ab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:17.704965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1b49c2f8-7929-43c8-8e84-30508f44c6ab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:17.713679 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1b49c2f8-7929-43c8-8e84-30508f44c6ab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:17.714154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1b49c2f8-7929-43c8-8e84-30508f44c6ab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:17.715080 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1b49c2f8-7929-43c8-8e84-30508f44c6ab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:17.715590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1b49c2f8-7929-43c8-8e84-30508f44c6ab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:17.863477 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1b49c2f8-7929-43c8-8e84-30508f44c6ab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:17.878223 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1b49c2f8-7929-43c8-8e84-30508f44c6ab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.177621 Jul 11 20:58:17.878819 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 74/152] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:17 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:18.024364 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-afc38db5-cbf3-4405-88db-f690ebf509ad tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:18.025001 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-afc38db5-cbf3-4405-88db-f690ebf509ad tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:18.037689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-afc38db5-cbf3-4405-88db-f690ebf509ad tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:18.037689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-afc38db5-cbf3-4405-88db-f690ebf509ad tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:18.037689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-afc38db5-cbf3-4405-88db-f690ebf509ad tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:18.037689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-afc38db5-cbf3-4405-88db-f690ebf509ad tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:18.185174 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-afc38db5-cbf3-4405-88db-f690ebf509ad tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:18.192757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-afc38db5-cbf3-4405-88db-f690ebf509ad tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.172404 Jul 11 20:58:18.193334 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 79/153] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:18 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:18.298235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-906c33f0-eb37-4c76-9560-f9a845dac414 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:18.298940 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-906c33f0-eb37-4c76-9560-f9a845dac414 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:18.305212 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-906c33f0-eb37-4c76-9560-f9a845dac414 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:18.305653 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-906c33f0-eb37-4c76-9560-f9a845dac414 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:18.306883 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-906c33f0-eb37-4c76-9560-f9a845dac414 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:18.307451 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-906c33f0-eb37-4c76-9560-f9a845dac414 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:18.447180 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-906c33f0-eb37-4c76-9560-f9a845dac414 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:18.458347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-906c33f0-eb37-4c76-9560-f9a845dac414 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.163594 Jul 11 20:58:18.459123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 75/154] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:18 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:18.566217 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:18.566757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:18.573025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:18.573437 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:18.574181 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:18.574603 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:18.719887 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:18.732220 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:18.734465 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:18.736088 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b044d381-7d92-4e75-bd91-4071724b30ca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.173877 Jul 11 20:58:18.737121 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 80/155] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:18 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:18.895766 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-99db5173-66ec-44e8-9ae7-4d9457a808df tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:18.896781 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-99db5173-66ec-44e8-9ae7-4d9457a808df tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:18.898745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=92 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:18.904908 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-99db5173-66ec-44e8-9ae7-4d9457a808df tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:18.905317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-99db5173-66ec-44e8-9ae7-4d9457a808df tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:18.906087 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-99db5173-66ec-44e8-9ae7-4d9457a808df tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:18.906511 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-99db5173-66ec-44e8-9ae7-4d9457a808df tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:19.059271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-99db5173-66ec-44e8-9ae7-4d9457a808df tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:19.069426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-99db5173-66ec-44e8-9ae7-4d9457a808df tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.177968 Jul 11 20:58:19.072689 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 76/156] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:18 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:19.201709 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-65ecb460-c26f-41a0-b4cb-c342947e0b46 req-b2cf5fe9-6265-43d9-a6ad-bea49a8c51b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ba91b13-c6e9-4273-b62f-09daf6fa9052", "name": "network-vif-plugged", "status": "completed", "tag": "d120ab5c-f331-4514-ab2f-aae660b85d36"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:19.210411 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-65ecb460-c26f-41a0-b4cb-c342947e0b46 req-b2cf5fe9-6265-43d9-a6ad-bea49a8c51b9 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:19.211075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-65ecb460-c26f-41a0-b4cb-c342947e0b46 req-b2cf5fe9-6265-43d9-a6ad-bea49a8c51b9 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:19.222822 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f2377d65-44d4-4814-b94a-2ff44c93e65f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:19.223485 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f2377d65-44d4-4814-b94a-2ff44c93e65f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:19.223678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-65ecb460-c26f-41a0-b4cb-c342947e0b46 req-b2cf5fe9-6265-43d9-a6ad-bea49a8c51b9 service nova] Creating event network-vif-plugged:d120ab5c-f331-4514-ab2f-aae660b85d36 for instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 on hv-cinder-84902 Jul 11 20:58:19.229819 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-65ecb460-c26f-41a0-b4cb-c342947e0b46 req-b2cf5fe9-6265-43d9-a6ad-bea49a8c51b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031415 Jul 11 20:58:19.231039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 81/157] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:58:19.232571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2377d65-44d4-4814-b94a-2ff44c93e65f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:19.233013 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2377d65-44d4-4814-b94a-2ff44c93e65f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:19.233768 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2377d65-44d4-4814-b94a-2ff44c93e65f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:19.234525 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2377d65-44d4-4814-b94a-2ff44c93e65f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:19.394475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f2377d65-44d4-4814-b94a-2ff44c93e65f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:19.410640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f2377d65-44d4-4814-b94a-2ff44c93e65f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.203741 Jul 11 20:58:19.411988 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 77/158] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:19 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:19.486634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-13554b94-fbbd-4cd2-a6f6-7a36ea8b26b9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:19.486634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-13554b94-fbbd-4cd2-a6f6-7a36ea8b26b9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:19.494683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13554b94-fbbd-4cd2-a6f6-7a36ea8b26b9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:19.495183 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13554b94-fbbd-4cd2-a6f6-7a36ea8b26b9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:19.496085 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13554b94-fbbd-4cd2-a6f6-7a36ea8b26b9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:19.496560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13554b94-fbbd-4cd2-a6f6-7a36ea8b26b9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:19.664514 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-13554b94-fbbd-4cd2-a6f6-7a36ea8b26b9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:19.674840 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-13554b94-fbbd-4cd2-a6f6-7a36ea8b26b9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.195291 Jul 11 20:58:19.685275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 82/159] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:19 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:19.756842 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:19.757720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:19.768791 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:19.774229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:19.776148 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:19.776817 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:20.088391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d81e2cf6-68ef-49b6-bef8-945ac11e6f39 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:20.089335 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d81e2cf6-68ef-49b6-bef8-945ac11e6f39 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:20.100946 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d81e2cf6-68ef-49b6-bef8-945ac11e6f39 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:20.101761 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d81e2cf6-68ef-49b6-bef8-945ac11e6f39 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:20.102714 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d81e2cf6-68ef-49b6-bef8-945ac11e6f39 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:20.105288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d81e2cf6-68ef-49b6-bef8-945ac11e6f39 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:20.244153 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d81e2cf6-68ef-49b6-bef8-945ac11e6f39 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:20.252949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d81e2cf6-68ef-49b6-bef8-945ac11e6f39 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.169429 Jul 11 20:58:20.254381 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 83/160] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:20 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:20.271730 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:20.280024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:20.281874 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:20.283893 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2a0e2851-c913-4f7a-8cc9-dee8f26d5409 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.532857 Jul 11 20:58:20.295543 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 78/161] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:19 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:20.429969 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d30f78fc-28ba-4923-a843-88954c564e10 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:20.430629 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d30f78fc-28ba-4923-a843-88954c564e10 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:20.438363 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d30f78fc-28ba-4923-a843-88954c564e10 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:20.438882 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d30f78fc-28ba-4923-a843-88954c564e10 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:20.439961 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d30f78fc-28ba-4923-a843-88954c564e10 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:20.440864 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d30f78fc-28ba-4923-a843-88954c564e10 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:20.628465 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d30f78fc-28ba-4923-a843-88954c564e10 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:20.636986 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d30f78fc-28ba-4923-a843-88954c564e10 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.212950 Jul 11 20:58:20.652441 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 84/162] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:20 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:20.696714 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f2a5ed29-ffe7-4e31-9945-730f3295a1e5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:20.696714 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f2a5ed29-ffe7-4e31-9945-730f3295a1e5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:20.706327 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2a5ed29-ffe7-4e31-9945-730f3295a1e5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:20.706830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2a5ed29-ffe7-4e31-9945-730f3295a1e5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:20.708096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2a5ed29-ffe7-4e31-9945-730f3295a1e5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:20.708732 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2a5ed29-ffe7-4e31-9945-730f3295a1e5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:20.868699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f2a5ed29-ffe7-4e31-9945-730f3295a1e5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:20.876871 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f2a5ed29-ffe7-4e31-9945-730f3295a1e5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.188632 Jul 11 20:58:20.877728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 79/163] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:20 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:21.254077 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-9ff0d212-b3f2-4f4d-8149-54b9b07e1cd9 req-08c1311c-97bd-4b68-8792-56d496e0e47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389834b1-1b82-41ba-8cfa-9c009f0446de", "name": "network-vif-plugged", "status": "completed", "tag": "ea0118de-f9e0-41d5-8073-29cbf9ea684d"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:21.263032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9ff0d212-b3f2-4f4d-8149-54b9b07e1cd9 req-08c1311c-97bd-4b68-8792-56d496e0e47d service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:21.263789 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9ff0d212-b3f2-4f4d-8149-54b9b07e1cd9 req-08c1311c-97bd-4b68-8792-56d496e0e47d service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:21.271608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ada803e5-7d7e-4861-8acd-3a53a0c94e35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:21.272597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ada803e5-7d7e-4861-8acd-3a53a0c94e35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:21.281466 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ada803e5-7d7e-4861-8acd-3a53a0c94e35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:21.285590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ada803e5-7d7e-4861-8acd-3a53a0c94e35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:21.286680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ada803e5-7d7e-4861-8acd-3a53a0c94e35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:21.287344 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ada803e5-7d7e-4861-8acd-3a53a0c94e35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:21.305666 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-9ff0d212-b3f2-4f4d-8149-54b9b07e1cd9 req-08c1311c-97bd-4b68-8792-56d496e0e47d service nova] Creating event network-vif-plugged:ea0118de-f9e0-41d5-8073-29cbf9ea684d for instance 389834b1-1b82-41ba-8cfa-9c009f0446de on hv-cinder-84902 Jul 11 20:58:21.316689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-9ff0d212-b3f2-4f4d-8149-54b9b07e1cd9 req-08c1311c-97bd-4b68-8792-56d496e0e47d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066119 Jul 11 20:58:21.317978 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 85/164] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:58:21.328749 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:21.331165 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:21.345040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:21.345606 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:21.350628 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:21.351250 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:21.505878 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ada803e5-7d7e-4861-8acd-3a53a0c94e35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:21.513771 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ada803e5-7d7e-4861-8acd-3a53a0c94e35 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.246637 Jul 11 20:58:21.523673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 80/165] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:21 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:21.552063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:21.560523 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:21.562221 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:21.563836 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a1a345a2-e4a2-45a4-884c-b7245ed9abed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.244579 Jul 11 20:58:21.564611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 86/166] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:21 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:21.655841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a612d943-dda5-486b-93df-80d13d5553e2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:21.656488 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a612d943-dda5-486b-93df-80d13d5553e2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:21.663574 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a612d943-dda5-486b-93df-80d13d5553e2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:21.664278 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a612d943-dda5-486b-93df-80d13d5553e2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:21.665248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a612d943-dda5-486b-93df-80d13d5553e2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:21.665913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a612d943-dda5-486b-93df-80d13d5553e2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:21.859687 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a612d943-dda5-486b-93df-80d13d5553e2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:21.870579 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a612d943-dda5-486b-93df-80d13d5553e2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.221019 Jul 11 20:58:21.872131 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 81/167] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:21 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:21.903848 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b158e87e-038b-4f90-9fc4-76130d5af744 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:21.907335 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b158e87e-038b-4f90-9fc4-76130d5af744 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:21.926147 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b158e87e-038b-4f90-9fc4-76130d5af744 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:21.928681 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b158e87e-038b-4f90-9fc4-76130d5af744 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:21.931214 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b158e87e-038b-4f90-9fc4-76130d5af744 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:21.936198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b158e87e-038b-4f90-9fc4-76130d5af744 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:22.186866 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b158e87e-038b-4f90-9fc4-76130d5af744 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:22.199693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b158e87e-038b-4f90-9fc4-76130d5af744 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.308895 Jul 11 20:58:22.200316 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 87/168] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:21 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:22.530811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-40913bc8-90d9-49dc-9636-39847223adb1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:22.532056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-40913bc8-90d9-49dc-9636-39847223adb1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:22.547456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40913bc8-90d9-49dc-9636-39847223adb1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:22.547902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40913bc8-90d9-49dc-9636-39847223adb1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:22.548696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40913bc8-90d9-49dc-9636-39847223adb1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:22.549126 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40913bc8-90d9-49dc-9636-39847223adb1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:22.581855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:22.582430 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:22.600040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:22.600519 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:22.601612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:22.602195 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:22.974317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-40913bc8-90d9-49dc-9636-39847223adb1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:22.975938 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:22.985088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-40913bc8-90d9-49dc-9636-39847223adb1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.458086 Jul 11 20:58:22.985682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 82/169] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:22 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:22.985982 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:22.987853 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:22.989237 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-797a7e48-adbb-4c61-9069-93b08500faa9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.411534 Jul 11 20:58:22.992786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 88/170] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:22 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:22.994319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5c1ea566-fc3c-4126-92f2-12bf598d08cf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:22.995054 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5c1ea566-fc3c-4126-92f2-12bf598d08cf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:23.001564 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5c1ea566-fc3c-4126-92f2-12bf598d08cf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:23.002261 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5c1ea566-fc3c-4126-92f2-12bf598d08cf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:23.003814 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5c1ea566-fc3c-4126-92f2-12bf598d08cf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:23.004370 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5c1ea566-fc3c-4126-92f2-12bf598d08cf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:23.217180 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-16f8fcb4-f0b3-43b5-9f17-56a12db0d7a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:23.226518 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-16f8fcb4-f0b3-43b5-9f17-56a12db0d7a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:23.239095 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-16f8fcb4-f0b3-43b5-9f17-56a12db0d7a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:23.242349 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-16f8fcb4-f0b3-43b5-9f17-56a12db0d7a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:23.243168 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-16f8fcb4-f0b3-43b5-9f17-56a12db0d7a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:23.243608 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-16f8fcb4-f0b3-43b5-9f17-56a12db0d7a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:23.270293 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5c1ea566-fc3c-4126-92f2-12bf598d08cf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:23.288662 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5c1ea566-fc3c-4126-92f2-12bf598d08cf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.298476 Jul 11 20:58:23.289947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 83/171] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:22 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:23.481921 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-cd3e0262-0318-4c49-a3f9-cce4c0d8bae4 req-6dea23a2-d669-46d3-a5da-90b1f3211d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d87067-da01-484a-86ca-e2ec49f5f15c", "name": "network-vif-plugged", "status": "completed", "tag": "425242f4-2849-48e1-b30f-b35706e4c781"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:23.510994 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-cd3e0262-0318-4c49-a3f9-cce4c0d8bae4 req-6dea23a2-d669-46d3-a5da-90b1f3211d4c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:23.511455 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-cd3e0262-0318-4c49-a3f9-cce4c0d8bae4 req-6dea23a2-d669-46d3-a5da-90b1f3211d4c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:23.540910 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-cd3e0262-0318-4c49-a3f9-cce4c0d8bae4 req-6dea23a2-d669-46d3-a5da-90b1f3211d4c service nova] Creating event network-vif-plugged:425242f4-2849-48e1-b30f-b35706e4c781 for instance 88d87067-da01-484a-86ca-e2ec49f5f15c on hv-cinder-84902 Jul 11 20:58:23.563825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-cd3e0262-0318-4c49-a3f9-cce4c0d8bae4 req-6dea23a2-d669-46d3-a5da-90b1f3211d4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086718 Jul 11 20:58:23.568506 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 84/172] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:58:23.711755 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-16f8fcb4-f0b3-43b5-9f17-56a12db0d7a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:23.725513 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-16f8fcb4-f0b3-43b5-9f17-56a12db0d7a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.512916 Jul 11 20:58:23.734761 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 89/173] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:23 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:24.009899 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:24.010496 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:24.012709 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-57813691-d33e-4a6f-b243-480d41ba1425 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:24.015058 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-57813691-d33e-4a6f-b243-480d41ba1425 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:24.022585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-57813691-d33e-4a6f-b243-480d41ba1425 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:24.022969 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:24.023539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:24.023912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-57813691-d33e-4a6f-b243-480d41ba1425 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:24.024452 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:24.024976 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-57813691-d33e-4a6f-b243-480d41ba1425 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:24.025332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:24.025669 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-57813691-d33e-4a6f-b243-480d41ba1425 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:24.219241 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-57813691-d33e-4a6f-b243-480d41ba1425 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:24.229752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-57813691-d33e-4a6f-b243-480d41ba1425 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.231199 Jul 11 20:58:24.229934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:24.230707 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 85/174] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:23 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:24.247185 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:24.250324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:24.261110 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f0215f56-cf41-4939-a232-0fe721cfb81b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.254930 Jul 11 20:58:24.265249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 90/175] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:24 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:24.307115 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a1ee78f4-62b9-4fd4-aaef-10d6ed02c9a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:24.308074 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a1ee78f4-62b9-4fd4-aaef-10d6ed02c9a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:24.316145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a1ee78f4-62b9-4fd4-aaef-10d6ed02c9a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:24.320435 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a1ee78f4-62b9-4fd4-aaef-10d6ed02c9a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:24.321865 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a1ee78f4-62b9-4fd4-aaef-10d6ed02c9a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:24.322751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a1ee78f4-62b9-4fd4-aaef-10d6ed02c9a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:24.743624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-15540576-bc6d-48d2-bba9-1a653a426db7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:24.744317 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-15540576-bc6d-48d2-bba9-1a653a426db7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:24.751613 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-15540576-bc6d-48d2-bba9-1a653a426db7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:24.752137 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-15540576-bc6d-48d2-bba9-1a653a426db7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:24.752906 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-15540576-bc6d-48d2-bba9-1a653a426db7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:24.753401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-15540576-bc6d-48d2-bba9-1a653a426db7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:24.775889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a1ee78f4-62b9-4fd4-aaef-10d6ed02c9a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:24.788722 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a1ee78f4-62b9-4fd4-aaef-10d6ed02c9a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.482564 Jul 11 20:58:24.789897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 86/176] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:24 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:24.966163 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-15540576-bc6d-48d2-bba9-1a653a426db7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:24.975706 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-15540576-bc6d-48d2-bba9-1a653a426db7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.236197 Jul 11 20:58:24.981353 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 91/177] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:24 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:25.248319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-942c8813-ce10-43bd-9e6c-fa10f05841cc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:25.248974 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-942c8813-ce10-43bd-9e6c-fa10f05841cc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:25.256085 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-942c8813-ce10-43bd-9e6c-fa10f05841cc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:25.256825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-942c8813-ce10-43bd-9e6c-fa10f05841cc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:25.257590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-942c8813-ce10-43bd-9e6c-fa10f05841cc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:25.258008 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-942c8813-ce10-43bd-9e6c-fa10f05841cc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:25.282524 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:25.283119 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:25.286922 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=100 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:25.290341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:25.291051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:25.292028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:25.292989 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:25.429102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-942c8813-ce10-43bd-9e6c-fa10f05841cc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:25.433478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:25.440422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-942c8813-ce10-43bd-9e6c-fa10f05841cc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.196232 Jul 11 20:58:25.450571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 87/178] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:25 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:25.521588 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:25.534087 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:25.535919 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:25.537102 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-36d5a1c5-e584-45c6-ba1b-9d59f961fd49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.258477 Jul 11 20:58:25.537666 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 92/179] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:25 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 20:58:25.809733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-763a233f-5830-40c5-a36f-b4d18e446676 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:25.811178 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-763a233f-5830-40c5-a36f-b4d18e446676 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:25.821609 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-763a233f-5830-40c5-a36f-b4d18e446676 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:25.822942 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-763a233f-5830-40c5-a36f-b4d18e446676 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:25.824749 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-763a233f-5830-40c5-a36f-b4d18e446676 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:25.826165 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-763a233f-5830-40c5-a36f-b4d18e446676 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:25.838605 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-3969859c-21be-4c66-bbdf-32c56586b8b4 req-e222fca4-a3e1-4075-a3ce-4c0da7e1e81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1536f24e-dc7b-4eaf-9b73-32205dbca872", "name": "network-vif-plugged", "status": "completed", "tag": "6878cb2c-c95a-44b5-8449-0da5fe06d309"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:25.856125 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-3969859c-21be-4c66-bbdf-32c56586b8b4 req-e222fca4-a3e1-4075-a3ce-4c0da7e1e81c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:25.857090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-3969859c-21be-4c66-bbdf-32c56586b8b4 req-e222fca4-a3e1-4075-a3ce-4c0da7e1e81c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:25.875308 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-3969859c-21be-4c66-bbdf-32c56586b8b4 req-e222fca4-a3e1-4075-a3ce-4c0da7e1e81c service nova] Creating event network-vif-plugged:6878cb2c-c95a-44b5-8449-0da5fe06d309 for instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 on hv-cinder-84902 Jul 11 20:58:25.883150 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-3969859c-21be-4c66-bbdf-32c56586b8b4 req-e222fca4-a3e1-4075-a3ce-4c0da7e1e81c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050742 Jul 11 20:58:25.884046 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 93/180] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:58:25.994128 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-879b8b0f-0400-44d9-a526-8870633fcba1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:25.995031 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-879b8b0f-0400-44d9-a526-8870633fcba1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:26.001648 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-879b8b0f-0400-44d9-a526-8870633fcba1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:26.002091 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-879b8b0f-0400-44d9-a526-8870633fcba1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:26.002944 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-879b8b0f-0400-44d9-a526-8870633fcba1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:26.003376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-879b8b0f-0400-44d9-a526-8870633fcba1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:26.021413 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-763a233f-5830-40c5-a36f-b4d18e446676 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:26.035814 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-763a233f-5830-40c5-a36f-b4d18e446676 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1314 microversion: 2.1 time: 0.232159 Jul 11 20:58:26.038095 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 88/181] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:25 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:26.184845 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-879b8b0f-0400-44d9-a526-8870633fcba1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:26.188861 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=100 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:26.193991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-879b8b0f-0400-44d9-a526-8870633fcba1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.204022 Jul 11 20:58:26.194734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 94/182] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:25 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:26.458526 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6f0ae8ed-6f2b-4a74-b2bf-f2ee74c26167 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:26.459835 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6f0ae8ed-6f2b-4a74-b2bf-f2ee74c26167 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:26.470672 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6f0ae8ed-6f2b-4a74-b2bf-f2ee74c26167 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:26.471388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6f0ae8ed-6f2b-4a74-b2bf-f2ee74c26167 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:26.472229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6f0ae8ed-6f2b-4a74-b2bf-f2ee74c26167 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:26.472777 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6f0ae8ed-6f2b-4a74-b2bf-f2ee74c26167 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:26.555815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:26.556886 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:26.576563 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:26.577052 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:26.577818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:26.580503 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:26.664295 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6f0ae8ed-6f2b-4a74-b2bf-f2ee74c26167 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:26.674693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6f0ae8ed-6f2b-4a74-b2bf-f2ee74c26167 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.220757 Jul 11 20:58:26.678812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 89/183] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:26 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:27.042749 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:27.054309 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ee2a8c59-2bae-4de9-bfa7-7fb761e4edd7 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:27.055190 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:27.055509 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ee2a8c59-2bae-4de9-bfa7-7fb761e4edd7 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:27.057182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:27.062733 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e3491f6d-5456-4e05-a8fd-870db0f2d7d9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.511212 Jul 11 20:58:27.063191 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee2a8c59-2bae-4de9-bfa7-7fb761e4edd7 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:27.063632 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee2a8c59-2bae-4de9-bfa7-7fb761e4edd7 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:27.064434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee2a8c59-2bae-4de9-bfa7-7fb761e4edd7 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:27.064871 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee2a8c59-2bae-4de9-bfa7-7fb761e4edd7 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:27.065475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 95/184] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:26 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 20:58:27.214764 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-af8729e4-d93e-4f92-8fad-a558261bc0ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:27.215385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-af8729e4-d93e-4f92-8fad-a558261bc0ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:27.224483 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af8729e4-d93e-4f92-8fad-a558261bc0ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:27.224976 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af8729e4-d93e-4f92-8fad-a558261bc0ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:27.225889 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af8729e4-d93e-4f92-8fad-a558261bc0ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:27.226318 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af8729e4-d93e-4f92-8fad-a558261bc0ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:27.461137 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ee2a8c59-2bae-4de9-bfa7-7fb761e4edd7 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:27.470634 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ee2a8c59-2bae-4de9-bfa7-7fb761e4edd7 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1501 microversion: 2.1 time: 0.420110 Jul 11 20:58:27.472999 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 90/185] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:27 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1501 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:27.527762 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-af8729e4-d93e-4f92-8fad-a558261bc0ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:27.537771 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-af8729e4-d93e-4f92-8fad-a558261bc0ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1321 microversion: 2.1 time: 0.325773 Jul 11 20:58:27.547283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 96/186] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:27 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:27.698907 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-64ad2482-6646-49a3-a74f-f027a2d1f34e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:27.700464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-64ad2482-6646-49a3-a74f-f027a2d1f34e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:27.714996 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-64ad2482-6646-49a3-a74f-f027a2d1f34e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:27.717692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-64ad2482-6646-49a3-a74f-f027a2d1f34e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:27.720689 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-64ad2482-6646-49a3-a74f-f027a2d1f34e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:27.722431 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-64ad2482-6646-49a3-a74f-f027a2d1f34e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:27.923308 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-64ad2482-6646-49a3-a74f-f027a2d1f34e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:27.934754 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-64ad2482-6646-49a3-a74f-f027a2d1f34e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.240723 Jul 11 20:58:27.935712 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 91/187] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:27 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:28.083274 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:28.084006 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:28.094118 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:28.095549 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:28.096651 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:28.098169 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:28.399907 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:28.411522 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:28.413083 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:28.414234 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f9fc8838-bd58-4e2f-94c7-7d2e802e10e4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.335340 Jul 11 20:58:28.414783 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 97/188] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:28 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 20:58:28.556121 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-439ecd60-ca7d-4b8c-a821-50b3a52648a7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:28.557112 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-439ecd60-ca7d-4b8c-a821-50b3a52648a7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:28.566987 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-439ecd60-ca7d-4b8c-a821-50b3a52648a7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:28.567587 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-439ecd60-ca7d-4b8c-a821-50b3a52648a7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:28.569130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-439ecd60-ca7d-4b8c-a821-50b3a52648a7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:28.569578 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-439ecd60-ca7d-4b8c-a821-50b3a52648a7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:28.749341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-439ecd60-ca7d-4b8c-a821-50b3a52648a7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:28.769161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-439ecd60-ca7d-4b8c-a821-50b3a52648a7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1515 microversion: 2.1 time: 0.218180 Jul 11 20:58:28.771244 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 92/189] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:28 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:28.790929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-57ad3bc8-7cb8-42ef-921e-78de192ced46 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:28.792012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-57ad3bc8-7cb8-42ef-921e-78de192ced46 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:28.800176 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-57ad3bc8-7cb8-42ef-921e-78de192ced46 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:28.800984 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-57ad3bc8-7cb8-42ef-921e-78de192ced46 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:28.801964 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-57ad3bc8-7cb8-42ef-921e-78de192ced46 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:28.802591 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-57ad3bc8-7cb8-42ef-921e-78de192ced46 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:28.880010 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-57ad3bc8-7cb8-42ef-921e-78de192ced46 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lazy-loading 'flavor' on Instance uuid 389834b1-1b82-41ba-8cfa-9c009f0446de {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 20:58:28.952440 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2e607006-bc75-4a4f-a516-0c10a61ed373 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:28.953063 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2e607006-bc75-4a4f-a516-0c10a61ed373 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:28.963124 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2e607006-bc75-4a4f-a516-0c10a61ed373 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:28.963550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2e607006-bc75-4a4f-a516-0c10a61ed373 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:28.967161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2e607006-bc75-4a4f-a516-0c10a61ed373 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:28.967847 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2e607006-bc75-4a4f-a516-0c10a61ed373 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:29.044647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-57ad3bc8-7cb8-42ef-921e-78de192ced46 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de/action" status: 200 len: 32 microversion: 2.1 time: 0.257532 Jul 11 20:58:29.047106 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 98/190] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 20:58:28 2022] POST /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 20:58:29.061270 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-debf37b6-af63-4f3d-8bdc-6c6673913397 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:29.062216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-debf37b6-af63-4f3d-8bdc-6c6673913397 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:29.069806 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-debf37b6-af63-4f3d-8bdc-6c6673913397 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:29.070654 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-debf37b6-af63-4f3d-8bdc-6c6673913397 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:29.071741 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-debf37b6-af63-4f3d-8bdc-6c6673913397 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:29.072464 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-debf37b6-af63-4f3d-8bdc-6c6673913397 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:29.192902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2e607006-bc75-4a4f-a516-0c10a61ed373 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:29.202974 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2e607006-bc75-4a4f-a516-0c10a61ed373 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.256037 Jul 11 20:58:29.203799 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 93/191] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:28 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:29.210214 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-42069993-760a-4386-aba7-de7d06575be4 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f39c7e82-fa70-4c40-adf3-e122cc7d6cc5"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:29.211912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-42069993-760a-4386-aba7-de7d06575be4 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:29.221839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-42069993-760a-4386-aba7-de7d06575be4 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:29.222633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-42069993-760a-4386-aba7-de7d06575be4 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:29.223613 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-42069993-760a-4386-aba7-de7d06575be4 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:29.224291 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-42069993-760a-4386-aba7-de7d06575be4 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:29.265002 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-debf37b6-af63-4f3d-8bdc-6c6673913397 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:29.277702 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-debf37b6-af63-4f3d-8bdc-6c6673913397 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.224001 Jul 11 20:58:29.279121 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 99/192] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:29 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:29.435164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:29.436297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:29.446149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:29.446826 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:29.447767 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:29.448370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:29.671239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:29.699666 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:29.712661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:29.714113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2db90807-8931-49c2-bf52-8b5cf22cd8b0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1408 microversion: 2.20 time: 0.285687 Jul 11 20:58:29.715750 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 100/193] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:29 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 20:58:29.852173 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-42069993-760a-4386-aba7-de7d06575be4 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "POST /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646373 Jul 11 20:58:29.864428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 94/194] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 20:58:29 2022] POST /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052/os-volume_attachments => generated 194 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:58:30.220816 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-58442988-7827-455e-a7f5-3182a9dd50d9 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:30.221684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-58442988-7827-455e-a7f5-3182a9dd50d9 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:30.230564 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58442988-7827-455e-a7f5-3182a9dd50d9 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:30.231321 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58442988-7827-455e-a7f5-3182a9dd50d9 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:30.232220 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58442988-7827-455e-a7f5-3182a9dd50d9 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:30.232853 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58442988-7827-455e-a7f5-3182a9dd50d9 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:30.299715 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f3177904-7dc3-4176-b408-a346a68e2775 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:30.300683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f3177904-7dc3-4176-b408-a346a68e2775 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:30.325230 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f3177904-7dc3-4176-b408-a346a68e2775 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:30.326614 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f3177904-7dc3-4176-b408-a346a68e2775 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:30.333633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f3177904-7dc3-4176-b408-a346a68e2775 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:30.334911 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f3177904-7dc3-4176-b408-a346a68e2775 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:30.461678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-58442988-7827-455e-a7f5-3182a9dd50d9 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:30.475758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-58442988-7827-455e-a7f5-3182a9dd50d9 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.258985 Jul 11 20:58:30.477694 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 101/195] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:30 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:30.520564 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f3177904-7dc3-4176-b408-a346a68e2775 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:30.533151 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f3177904-7dc3-4176-b408-a346a68e2775 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.241268 Jul 11 20:58:30.534410 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 95/196] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:30 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:30.733269 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:30.734074 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:30.740713 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:30.741290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:30.742104 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:30.742728 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:30.981782 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:30.997761 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:31.003748 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:31.007545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6237157d-82b3-4e0d-8415-c83ab8629fce tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1600 microversion: 2.20 time: 0.278246 Jul 11 20:58:31.024146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 102/197] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 20:58:30 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1600 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 20:58:31.028709 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8c8605e9-ea12-42b9-b137-100052bfd03b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:31.029434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8c8605e9-ea12-42b9-b137-100052bfd03b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:31.038629 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8c8605e9-ea12-42b9-b137-100052bfd03b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:31.039350 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8c8605e9-ea12-42b9-b137-100052bfd03b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:31.041904 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8c8605e9-ea12-42b9-b137-100052bfd03b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:31.043527 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8c8605e9-ea12-42b9-b137-100052bfd03b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:31.152384 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8c8605e9-ea12-42b9-b137-100052bfd03b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.127767 Jul 11 20:58:31.153102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 96/198] 10.222.0.20 () {60 vars in 1315 bytes} [Mon Jul 11 20:58:31 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 20:58:31.499123 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c2b32c5e-71a9-4ca0-b2b7-2ac05acb2bec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:31.499778 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c2b32c5e-71a9-4ca0-b2b7-2ac05acb2bec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:31.507958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c2b32c5e-71a9-4ca0-b2b7-2ac05acb2bec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:31.510153 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c2b32c5e-71a9-4ca0-b2b7-2ac05acb2bec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:31.514650 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c2b32c5e-71a9-4ca0-b2b7-2ac05acb2bec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:31.515126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c2b32c5e-71a9-4ca0-b2b7-2ac05acb2bec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:31.552310 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-44935d19-5230-4700-b2d2-b90a565f689f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:31.553096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-44935d19-5230-4700-b2d2-b90a565f689f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:31.563487 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-44935d19-5230-4700-b2d2-b90a565f689f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:31.573467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-44935d19-5230-4700-b2d2-b90a565f689f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:31.574596 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-44935d19-5230-4700-b2d2-b90a565f689f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:31.575096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-44935d19-5230-4700-b2d2-b90a565f689f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:31.856580 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-44935d19-5230-4700-b2d2-b90a565f689f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:31.865982 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-44935d19-5230-4700-b2d2-b90a565f689f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.319548 Jul 11 20:58:31.867430 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 97/199] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:31 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:31.903164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c2b32c5e-71a9-4ca0-b2b7-2ac05acb2bec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:31.929546 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c2b32c5e-71a9-4ca0-b2b7-2ac05acb2bec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1362 microversion: 2.1 time: 0.436357 Jul 11 20:58:31.930148 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 103/200] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:31 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:32.883555 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5aec0f77-d9a3-4785-9e32-8a9e7dd58ed8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:32.885494 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5aec0f77-d9a3-4785-9e32-8a9e7dd58ed8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:32.894432 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5aec0f77-d9a3-4785-9e32-8a9e7dd58ed8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:32.895188 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5aec0f77-d9a3-4785-9e32-8a9e7dd58ed8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:32.896201 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5aec0f77-d9a3-4785-9e32-8a9e7dd58ed8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:32.896753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5aec0f77-d9a3-4785-9e32-8a9e7dd58ed8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:32.947504 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3c8de3d9-add2-4852-801a-87a6eb118cc5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:32.948132 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3c8de3d9-add2-4852-801a-87a6eb118cc5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:32.958848 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3c8de3d9-add2-4852-801a-87a6eb118cc5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:32.959351 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3c8de3d9-add2-4852-801a-87a6eb118cc5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:32.960182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3c8de3d9-add2-4852-801a-87a6eb118cc5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:32.960623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3c8de3d9-add2-4852-801a-87a6eb118cc5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:33.085717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5aec0f77-d9a3-4785-9e32-8a9e7dd58ed8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:33.100089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5aec0f77-d9a3-4785-9e32-8a9e7dd58ed8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.220384 Jul 11 20:58:33.100967 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 98/201] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:32 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:33.214487 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3c8de3d9-add2-4852-801a-87a6eb118cc5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:33.224396 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3c8de3d9-add2-4852-801a-87a6eb118cc5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1547 microversion: 2.1 time: 0.280600 Jul 11 20:58:33.233214 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 104/202] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:32 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1547 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:33.245885 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6fb4ac4d-9d1f-431a-b461-07963c1ee6b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:33.246636 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6fb4ac4d-9d1f-431a-b461-07963c1ee6b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:33.255120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fb4ac4d-9d1f-431a-b461-07963c1ee6b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:33.255784 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fb4ac4d-9d1f-431a-b461-07963c1ee6b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:33.256739 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fb4ac4d-9d1f-431a-b461-07963c1ee6b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:33.257328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fb4ac4d-9d1f-431a-b461-07963c1ee6b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:33.365373 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6fb4ac4d-9d1f-431a-b461-07963c1ee6b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125342 Jul 11 20:58:33.366597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 99/203] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jul 11 20:58:33 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 20:58:33.457238 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-c276552d-79f7-4d95-a4d5-7f330df8c556 req-799180e5-fa57-4b3d-bbbc-1105720c323b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1536f24e-dc7b-4eaf-9b73-32205dbca872", "tag": "6878cb2c-c95a-44b5-8449-0da5fe06d309"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:33.480730 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-c276552d-79f7-4d95-a4d5-7f330df8c556 req-799180e5-fa57-4b3d-bbbc-1105720c323b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:33.481242 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-c276552d-79f7-4d95-a4d5-7f330df8c556 req-799180e5-fa57-4b3d-bbbc-1105720c323b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:33.508272 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-c276552d-79f7-4d95-a4d5-7f330df8c556 req-799180e5-fa57-4b3d-bbbc-1105720c323b service nova] Creating event network-changed:6878cb2c-c95a-44b5-8449-0da5fe06d309 for instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 on hv-cinder-84902 Jul 11 20:58:33.514318 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-c276552d-79f7-4d95-a4d5-7f330df8c556 req-799180e5-fa57-4b3d-bbbc-1105720c323b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066761 Jul 11 20:58:33.514938 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 105/204] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:58:34.117970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9db0a7a3-8c4c-485b-9609-4c1054ffd505 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:34.119183 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9db0a7a3-8c4c-485b-9609-4c1054ffd505 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:34.128958 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9db0a7a3-8c4c-485b-9609-4c1054ffd505 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:34.129660 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9db0a7a3-8c4c-485b-9609-4c1054ffd505 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:34.130579 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9db0a7a3-8c4c-485b-9609-4c1054ffd505 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:34.131145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9db0a7a3-8c4c-485b-9609-4c1054ffd505 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:34.657796 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9db0a7a3-8c4c-485b-9609-4c1054ffd505 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:34.667772 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9db0a7a3-8c4c-485b-9609-4c1054ffd505 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.553965 Jul 11 20:58:34.669065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 100/205] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:34 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:35.195447 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-9ca5b7f7-7bdc-45b5-9499-ec78cd6288ea req-978625aa-3a97-4377-9b42-47c46714b4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d87067-da01-484a-86ca-e2ec49f5f15c", "tag": "425242f4-2849-48e1-b30f-b35706e4c781"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:35.215671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9ca5b7f7-7bdc-45b5-9499-ec78cd6288ea req-978625aa-3a97-4377-9b42-47c46714b4b6 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:35.216228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9ca5b7f7-7bdc-45b5-9499-ec78cd6288ea req-978625aa-3a97-4377-9b42-47c46714b4b6 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:35.243851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-9ca5b7f7-7bdc-45b5-9499-ec78cd6288ea req-978625aa-3a97-4377-9b42-47c46714b4b6 service nova] Creating event network-changed:425242f4-2849-48e1-b30f-b35706e4c781 for instance 88d87067-da01-484a-86ca-e2ec49f5f15c on hv-cinder-84902 Jul 11 20:58:35.253951 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-9ca5b7f7-7bdc-45b5-9499-ec78cd6288ea req-978625aa-3a97-4377-9b42-47c46714b4b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062651 Jul 11 20:58:35.255106 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 106/206] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:58:35.688516 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-33bc3546-d693-49b2-85eb-0af20667edcf tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:35.690058 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-33bc3546-d693-49b2-85eb-0af20667edcf tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:35.704244 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-33bc3546-d693-49b2-85eb-0af20667edcf tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:35.705116 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-33bc3546-d693-49b2-85eb-0af20667edcf tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:35.710811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-33bc3546-d693-49b2-85eb-0af20667edcf tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:35.712096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-33bc3546-d693-49b2-85eb-0af20667edcf tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:35.936810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-33bc3546-d693-49b2-85eb-0af20667edcf tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:35.946477 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-33bc3546-d693-49b2-85eb-0af20667edcf tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.263322 Jul 11 20:58:35.949400 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 101/207] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:35 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:36.972515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0df5ea1b-bbab-417c-a246-ac08dd64d051 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:36.973214 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0df5ea1b-bbab-417c-a246-ac08dd64d051 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:36.980531 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0df5ea1b-bbab-417c-a246-ac08dd64d051 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:36.981207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0df5ea1b-bbab-417c-a246-ac08dd64d051 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:36.981995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0df5ea1b-bbab-417c-a246-ac08dd64d051 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:36.982420 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0df5ea1b-bbab-417c-a246-ac08dd64d051 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:37.159648 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0df5ea1b-bbab-417c-a246-ac08dd64d051 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:37.170229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0df5ea1b-bbab-417c-a246-ac08dd64d051 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.207124 Jul 11 20:58:37.171149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 107/208] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:36 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:38.186947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5b903650-76ee-497e-92fc-0b669afd5317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:38.187542 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5b903650-76ee-497e-92fc-0b669afd5317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:38.194534 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b903650-76ee-497e-92fc-0b669afd5317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:38.195300 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b903650-76ee-497e-92fc-0b669afd5317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:38.196753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b903650-76ee-497e-92fc-0b669afd5317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:38.197627 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b903650-76ee-497e-92fc-0b669afd5317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:38.408349 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5b903650-76ee-497e-92fc-0b669afd5317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:38.420970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5b903650-76ee-497e-92fc-0b669afd5317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.237539 Jul 11 20:58:38.423327 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 102/209] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:38 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:39.438749 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-edff3924-6fae-418a-a57d-b8ca70d61684 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:39.446413 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-edff3924-6fae-418a-a57d-b8ca70d61684 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:39.457710 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-edff3924-6fae-418a-a57d-b8ca70d61684 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:39.458204 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-edff3924-6fae-418a-a57d-b8ca70d61684 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:39.460836 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-edff3924-6fae-418a-a57d-b8ca70d61684 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:39.461639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-edff3924-6fae-418a-a57d-b8ca70d61684 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:39.695657 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-edff3924-6fae-418a-a57d-b8ca70d61684 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:39.713809 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-edff3924-6fae-418a-a57d-b8ca70d61684 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.278695 Jul 11 20:58:39.721575 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 108/210] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:39 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:40.734691 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cbeb9069-df3f-4a7b-b8af-997700c0c356 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:40.735421 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cbeb9069-df3f-4a7b-b8af-997700c0c356 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:40.742069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cbeb9069-df3f-4a7b-b8af-997700c0c356 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:40.742723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cbeb9069-df3f-4a7b-b8af-997700c0c356 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:40.743464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cbeb9069-df3f-4a7b-b8af-997700c0c356 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:40.743903 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cbeb9069-df3f-4a7b-b8af-997700c0c356 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:40.904945 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cbeb9069-df3f-4a7b-b8af-997700c0c356 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:40.908782 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:40.913729 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cbeb9069-df3f-4a7b-b8af-997700c0c356 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.182837 Jul 11 20:58:40.914627 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 103/211] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:40 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:41.933199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c99572bf-8da1-498b-a064-460156322c8b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:41.934555 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c99572bf-8da1-498b-a064-460156322c8b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:41.942552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c99572bf-8da1-498b-a064-460156322c8b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:41.942990 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c99572bf-8da1-498b-a064-460156322c8b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:41.943751 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c99572bf-8da1-498b-a064-460156322c8b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:41.944194 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c99572bf-8da1-498b-a064-460156322c8b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:42.083439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c99572bf-8da1-498b-a064-460156322c8b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:42.092453 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c99572bf-8da1-498b-a064-460156322c8b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.164490 Jul 11 20:58:42.093047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 109/212] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:41 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:43.110143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7a7b7f89-8e2f-472f-af91-e3936d480a81 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:43.110778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7a7b7f89-8e2f-472f-af91-e3936d480a81 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:43.119013 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a7b7f89-8e2f-472f-af91-e3936d480a81 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:43.119467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a7b7f89-8e2f-472f-af91-e3936d480a81 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:43.120582 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a7b7f89-8e2f-472f-af91-e3936d480a81 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:43.120695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a7b7f89-8e2f-472f-af91-e3936d480a81 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:43.288146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7a7b7f89-8e2f-472f-af91-e3936d480a81 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:43.295044 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7a7b7f89-8e2f-472f-af91-e3936d480a81 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.188756 Jul 11 20:58:43.295698 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 104/213] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:43 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:43.352301 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c5cd5e33-9c57-4652-94f2-5189130a632f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:43.352829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c5cd5e33-9c57-4652-94f2-5189130a632f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:43.358913 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c5cd5e33-9c57-4652-94f2-5189130a632f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:43.359353 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c5cd5e33-9c57-4652-94f2-5189130a632f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:43.360127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c5cd5e33-9c57-4652-94f2-5189130a632f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:43.360561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c5cd5e33-9c57-4652-94f2-5189130a632f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:43.387193 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c5cd5e33-9c57-4652-94f2-5189130a632f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 20:58:43.390261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:43.484429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c5cd5e33-9c57-4652-94f2-5189130a632f tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 204 len: 0 microversion: 2.1 time: 0.135516 Jul 11 20:58:43.485660 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 110/214] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 20:58:43 2022] DELETE /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 20:58:43.496357 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d4a3e790-52fd-4b42-81a7-5d08c186bbaf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:43.497128 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d4a3e790-52fd-4b42-81a7-5d08c186bbaf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:43.503638 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d4a3e790-52fd-4b42-81a7-5d08c186bbaf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:43.504038 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d4a3e790-52fd-4b42-81a7-5d08c186bbaf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:43.505028 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d4a3e790-52fd-4b42-81a7-5d08c186bbaf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:43.505477 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d4a3e790-52fd-4b42-81a7-5d08c186bbaf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:43.655142 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d4a3e790-52fd-4b42-81a7-5d08c186bbaf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:43.663949 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d4a3e790-52fd-4b42-81a7-5d08c186bbaf tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.172874 Jul 11 20:58:43.664752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 105/215] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:43 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:44.315012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c7f84a41-e80f-4f5f-93e7-4e3a919d7748 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:44.315890 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c7f84a41-e80f-4f5f-93e7-4e3a919d7748 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:44.323748 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c7f84a41-e80f-4f5f-93e7-4e3a919d7748 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:44.324341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c7f84a41-e80f-4f5f-93e7-4e3a919d7748 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c7f84a41-e80f-4f5f-93e7-4e3a919d7748 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:44.325804 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c7f84a41-e80f-4f5f-93e7-4e3a919d7748 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:44.461937 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c7f84a41-e80f-4f5f-93e7-4e3a919d7748 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:44.472894 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c7f84a41-e80f-4f5f-93e7-4e3a919d7748 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.163005 Jul 11 20:58:44.473790 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 111/216] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:44 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:44.685129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f8186f02-6cc4-4fda-ace4-7e33d5bb8a27 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:44.686088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f8186f02-6cc4-4fda-ace4-7e33d5bb8a27 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:44.694516 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f8186f02-6cc4-4fda-ace4-7e33d5bb8a27 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:44.694985 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f8186f02-6cc4-4fda-ace4-7e33d5bb8a27 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:44.695733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f8186f02-6cc4-4fda-ace4-7e33d5bb8a27 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:44.696162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f8186f02-6cc4-4fda-ace4-7e33d5bb8a27 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:44.847319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f8186f02-6cc4-4fda-ace4-7e33d5bb8a27 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:44.855835 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f8186f02-6cc4-4fda-ace4-7e33d5bb8a27 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.177148 Jul 11 20:58:44.856460 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 106/217] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:44 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:45.498923 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-46c4a17d-a83a-4d01-8aad-b38a5dd01e91 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:45.499745 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-46c4a17d-a83a-4d01-8aad-b38a5dd01e91 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:45.507798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-46c4a17d-a83a-4d01-8aad-b38a5dd01e91 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:45.508272 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-46c4a17d-a83a-4d01-8aad-b38a5dd01e91 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:45.509019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-46c4a17d-a83a-4d01-8aad-b38a5dd01e91 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:45.509449 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-46c4a17d-a83a-4d01-8aad-b38a5dd01e91 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:45.654842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-46c4a17d-a83a-4d01-8aad-b38a5dd01e91 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:45.662997 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-46c4a17d-a83a-4d01-8aad-b38a5dd01e91 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.170701 Jul 11 20:58:45.663582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 112/218] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:45 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:45.873530 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8b2be115-9889-4342-be3e-595c8680d027 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:45.874133 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8b2be115-9889-4342-be3e-595c8680d027 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:45.881249 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b2be115-9889-4342-be3e-595c8680d027 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:45.881710 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b2be115-9889-4342-be3e-595c8680d027 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:45.882474 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b2be115-9889-4342-be3e-595c8680d027 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:45.882896 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b2be115-9889-4342-be3e-595c8680d027 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:46.021535 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8b2be115-9889-4342-be3e-595c8680d027 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:46.029884 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8b2be115-9889-4342-be3e-595c8680d027 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.160387 Jul 11 20:58:46.030459 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 107/219] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:45 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:46.683507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-611aa9a2-d179-4549-956b-f8f823b9f884 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:46.684413 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-611aa9a2-d179-4549-956b-f8f823b9f884 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:46.693316 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-611aa9a2-d179-4549-956b-f8f823b9f884 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:46.693956 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-611aa9a2-d179-4549-956b-f8f823b9f884 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:46.695012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-611aa9a2-d179-4549-956b-f8f823b9f884 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:46.695650 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-611aa9a2-d179-4549-956b-f8f823b9f884 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:46.835734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-611aa9a2-d179-4549-956b-f8f823b9f884 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:46.843390 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-611aa9a2-d179-4549-956b-f8f823b9f884 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.165870 Jul 11 20:58:46.843955 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 113/220] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:46 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:47.047290 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0b24455f-c543-48d3-ae0a-3d56a5888280 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:47.047825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0b24455f-c543-48d3-ae0a-3d56a5888280 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:47.055445 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0b24455f-c543-48d3-ae0a-3d56a5888280 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:47.055881 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0b24455f-c543-48d3-ae0a-3d56a5888280 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:47.057068 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0b24455f-c543-48d3-ae0a-3d56a5888280 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:47.057495 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0b24455f-c543-48d3-ae0a-3d56a5888280 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:47.192333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0b24455f-c543-48d3-ae0a-3d56a5888280 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:47.202289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0b24455f-c543-48d3-ae0a-3d56a5888280 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.159130 Jul 11 20:58:47.202888 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 108/221] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:47 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:47.863858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-030e1252-89c3-4bc3-8fd6-04aaa63b6ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:47.864457 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-030e1252-89c3-4bc3-8fd6-04aaa63b6ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:47.871720 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-030e1252-89c3-4bc3-8fd6-04aaa63b6ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:47.872171 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-030e1252-89c3-4bc3-8fd6-04aaa63b6ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:47.873282 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-030e1252-89c3-4bc3-8fd6-04aaa63b6ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:47.873802 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-030e1252-89c3-4bc3-8fd6-04aaa63b6ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:48.015078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-030e1252-89c3-4bc3-8fd6-04aaa63b6ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:48.025039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-030e1252-89c3-4bc3-8fd6-04aaa63b6ec5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.167607 Jul 11 20:58:48.025607 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 114/222] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:47 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:48.219682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-22371a9f-99e5-4630-a5af-afa3656ad265 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:48.220251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-22371a9f-99e5-4630-a5af-afa3656ad265 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:48.227571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-22371a9f-99e5-4630-a5af-afa3656ad265 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:48.228021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-22371a9f-99e5-4630-a5af-afa3656ad265 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:48.228811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-22371a9f-99e5-4630-a5af-afa3656ad265 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:48.229411 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-22371a9f-99e5-4630-a5af-afa3656ad265 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:48.366232 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-22371a9f-99e5-4630-a5af-afa3656ad265 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:48.374897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-22371a9f-99e5-4630-a5af-afa3656ad265 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.159245 Jul 11 20:58:48.376171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 109/223] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:48 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:49.041921 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b7bc252e-70d5-40c9-afdf-432cd34b583c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:49.042516 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b7bc252e-70d5-40c9-afdf-432cd34b583c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:49.049359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7bc252e-70d5-40c9-afdf-432cd34b583c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:49.049831 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7bc252e-70d5-40c9-afdf-432cd34b583c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:49.050689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7bc252e-70d5-40c9-afdf-432cd34b583c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:49.051184 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7bc252e-70d5-40c9-afdf-432cd34b583c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:49.196626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b7bc252e-70d5-40c9-afdf-432cd34b583c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:49.204571 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b7bc252e-70d5-40c9-afdf-432cd34b583c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.166618 Jul 11 20:58:49.205144 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 115/224] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:49 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:49.392002 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-93a53fd1-1d3d-4e5a-9250-6b0312f8e512 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:49.392707 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-93a53fd1-1d3d-4e5a-9250-6b0312f8e512 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:49.395174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=68 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:49.401490 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-93a53fd1-1d3d-4e5a-9250-6b0312f8e512 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:49.401930 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-93a53fd1-1d3d-4e5a-9250-6b0312f8e512 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:49.402860 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-93a53fd1-1d3d-4e5a-9250-6b0312f8e512 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:49.403289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-93a53fd1-1d3d-4e5a-9250-6b0312f8e512 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:49.540790 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-93a53fd1-1d3d-4e5a-9250-6b0312f8e512 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:49.550688 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-93a53fd1-1d3d-4e5a-9250-6b0312f8e512 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.162568 Jul 11 20:58:49.551539 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 110/225] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:49 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:50.221991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-09977e8d-e516-4c5b-9b83-2514eaf0193a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:50.222561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-09977e8d-e516-4c5b-9b83-2514eaf0193a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:50.229824 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09977e8d-e516-4c5b-9b83-2514eaf0193a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:50.230206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09977e8d-e516-4c5b-9b83-2514eaf0193a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:50.230960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09977e8d-e516-4c5b-9b83-2514eaf0193a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:50.231388 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09977e8d-e516-4c5b-9b83-2514eaf0193a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:50.372419 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-09977e8d-e516-4c5b-9b83-2514eaf0193a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:50.384036 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-09977e8d-e516-4c5b-9b83-2514eaf0193a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.165820 Jul 11 20:58:50.384633 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 116/226] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:50 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:50.487401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2001678640", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "networks": [{"uuid": "eebfd3c1-d32f-4bbf-85c2-74848e36804e"}]}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:50.548665 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] validate_networks() for [('eebfd3c1-d32f-4bbf-85c2-74848e36804e', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 20:58:50.572566 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2df60b7c-d9fc-446b-9756-b4b7241326a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:50.573174 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2df60b7c-d9fc-446b-9756-b4b7241326a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:50.579762 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2df60b7c-d9fc-446b-9756-b4b7241326a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:50.580235 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2df60b7c-d9fc-446b-9756-b4b7241326a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:50.581014 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2df60b7c-d9fc-446b-9756-b4b7241326a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:50.581442 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2df60b7c-d9fc-446b-9756-b4b7241326a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:50.715822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2df60b7c-d9fc-446b-9756-b4b7241326a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:50.724418 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2df60b7c-d9fc-446b-9756-b4b7241326a8 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.156924 Jul 11 20:58:50.724991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 117/227] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:50 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:50.926332 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 20:58:50.926747 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 20:58:50.927216 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 20:58:50.927614 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 20:58:50.928013 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 20:58:50.938584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:50.939026 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:50.939814 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:50.940305 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:50.957737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Getting quotas for project 804c8a0ad1674b818f8bbc53d661284b. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:58:50.962038 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Getting quotas for user 934b314c46824d5397a0ae92bb07b725 and project 804c8a0ad1674b818f8bbc53d661284b. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:58:50.973897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 20:58:50.976263 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 20:58:51.023415 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e756c3f7-c352-48ab-a6f5-edb62e86553b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539594 Jul 11 20:58:51.024564 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 111/228] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 20:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 20:58:51.034269 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-376afadd-9660-48ff-a638-2e50dfbade50 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:51.035016 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-376afadd-9660-48ff-a638-2e50dfbade50 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:51.088553 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-376afadd-9660-48ff-a638-2e50dfbade50 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:51.095264 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-376afadd-9660-48ff-a638-2e50dfbade50 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1214 microversion: 2.1 time: 0.064935 Jul 11 20:58:51.095809 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 118/229] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:51 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:51.400638 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-70186196-e825-4f52-8f89-8bd0d6aae3ac tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:51.401336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-70186196-e825-4f52-8f89-8bd0d6aae3ac tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:51.408332 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-70186196-e825-4f52-8f89-8bd0d6aae3ac tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:51.408900 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-70186196-e825-4f52-8f89-8bd0d6aae3ac tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:51.409746 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-70186196-e825-4f52-8f89-8bd0d6aae3ac tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:51.410258 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-70186196-e825-4f52-8f89-8bd0d6aae3ac tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:51.547497 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-70186196-e825-4f52-8f89-8bd0d6aae3ac tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:51.555792 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-70186196-e825-4f52-8f89-8bd0d6aae3ac tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.159200 Jul 11 20:58:51.556845 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 112/230] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:51 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:51.744637 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1077c747-8213-40a5-8c3f-d17fd4dbf6d2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:51.745268 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1077c747-8213-40a5-8c3f-d17fd4dbf6d2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:51.752844 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1077c747-8213-40a5-8c3f-d17fd4dbf6d2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:51.753320 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1077c747-8213-40a5-8c3f-d17fd4dbf6d2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:51.754177 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1077c747-8213-40a5-8c3f-d17fd4dbf6d2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:51.754634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1077c747-8213-40a5-8c3f-d17fd4dbf6d2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:51.901539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1077c747-8213-40a5-8c3f-d17fd4dbf6d2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:51.912941 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1077c747-8213-40a5-8c3f-d17fd4dbf6d2 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.173813 Jul 11 20:58:51.913517 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 119/231] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:51 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:52.116619 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5c18520a-61e4-4790-818b-22a4ee3de031 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:52.117610 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5c18520a-61e4-4790-818b-22a4ee3de031 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:52.128180 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5c18520a-61e4-4790-818b-22a4ee3de031 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:52.128961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5c18520a-61e4-4790-818b-22a4ee3de031 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:52.130206 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5c18520a-61e4-4790-818b-22a4ee3de031 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:52.130921 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5c18520a-61e4-4790-818b-22a4ee3de031 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:52.206701 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5c18520a-61e4-4790-818b-22a4ee3de031 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:52.216342 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5c18520a-61e4-4790-818b-22a4ee3de031 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1218 microversion: 2.1 time: 0.106324 Jul 11 20:58:52.216907 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 113/232] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:52 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:52.573880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9743c4d3-4ec1-4dfe-a342-887fa6115de0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:52.574483 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9743c4d3-4ec1-4dfe-a342-887fa6115de0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:52.580950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9743c4d3-4ec1-4dfe-a342-887fa6115de0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:52.581386 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9743c4d3-4ec1-4dfe-a342-887fa6115de0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:52.582134 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9743c4d3-4ec1-4dfe-a342-887fa6115de0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:52.582557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9743c4d3-4ec1-4dfe-a342-887fa6115de0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:52.715571 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9743c4d3-4ec1-4dfe-a342-887fa6115de0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:52.723538 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9743c4d3-4ec1-4dfe-a342-887fa6115de0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.153781 Jul 11 20:58:52.724124 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 120/233] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:52 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:52.932640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-22b0cd6d-c8e4-4d26-bc92-f3595c7e92d3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:52.933198 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-22b0cd6d-c8e4-4d26-bc92-f3595c7e92d3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:52.940220 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-22b0cd6d-c8e4-4d26-bc92-f3595c7e92d3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:52.940665 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-22b0cd6d-c8e4-4d26-bc92-f3595c7e92d3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:52.941411 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-22b0cd6d-c8e4-4d26-bc92-f3595c7e92d3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:52.941835 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-22b0cd6d-c8e4-4d26-bc92-f3595c7e92d3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:53.084471 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-22b0cd6d-c8e4-4d26-bc92-f3595c7e92d3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:53.093360 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-22b0cd6d-c8e4-4d26-bc92-f3595c7e92d3 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.166214 Jul 11 20:58:53.093904 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 114/234] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:52 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:53.234736 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-015f9d34-f20c-48d5-8ce2-b3c5a54f6abb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:53.235361 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-015f9d34-f20c-48d5-8ce2-b3c5a54f6abb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:53.242113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-015f9d34-f20c-48d5-8ce2-b3c5a54f6abb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:53.242572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-015f9d34-f20c-48d5-8ce2-b3c5a54f6abb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:53.243334 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-015f9d34-f20c-48d5-8ce2-b3c5a54f6abb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:53.243758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-015f9d34-f20c-48d5-8ce2-b3c5a54f6abb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:53.309069 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-015f9d34-f20c-48d5-8ce2-b3c5a54f6abb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:53.317073 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-015f9d34-f20c-48d5-8ce2-b3c5a54f6abb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1218 microversion: 2.1 time: 0.086592 Jul 11 20:58:53.317887 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 121/235] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:53 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:53.741096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9e66c16d-79d5-4847-8595-a0f9788a6db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:53.741751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9e66c16d-79d5-4847-8595-a0f9788a6db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:53.749174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9e66c16d-79d5-4847-8595-a0f9788a6db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:53.749623 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9e66c16d-79d5-4847-8595-a0f9788a6db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:53.750408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9e66c16d-79d5-4847-8595-a0f9788a6db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:53.750845 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9e66c16d-79d5-4847-8595-a0f9788a6db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:53.890003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9e66c16d-79d5-4847-8595-a0f9788a6db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:53.901416 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9e66c16d-79d5-4847-8595-a0f9788a6db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.163912 Jul 11 20:58:53.902231 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 115/236] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:53 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:54.110650 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4efb3b63-b8fe-4a9d-b39f-9c66c1505499 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:54.111290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4efb3b63-b8fe-4a9d-b39f-9c66c1505499 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:54.117832 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4efb3b63-b8fe-4a9d-b39f-9c66c1505499 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:54.118276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4efb3b63-b8fe-4a9d-b39f-9c66c1505499 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:54.119038 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4efb3b63-b8fe-4a9d-b39f-9c66c1505499 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:54.119447 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4efb3b63-b8fe-4a9d-b39f-9c66c1505499 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:54.254800 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4efb3b63-b8fe-4a9d-b39f-9c66c1505499 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:54.264563 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4efb3b63-b8fe-4a9d-b39f-9c66c1505499 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.157667 Jul 11 20:58:54.265394 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 122/237] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:54 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:54.339662 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-30688cbd-6d8b-4b50-b7d7-e208fd61d976 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:54.340667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-30688cbd-6d8b-4b50-b7d7-e208fd61d976 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:54.351678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30688cbd-6d8b-4b50-b7d7-e208fd61d976 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:54.352482 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30688cbd-6d8b-4b50-b7d7-e208fd61d976 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:54.353728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30688cbd-6d8b-4b50-b7d7-e208fd61d976 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:54.354630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30688cbd-6d8b-4b50-b7d7-e208fd61d976 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:54.415238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-30688cbd-6d8b-4b50-b7d7-e208fd61d976 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:54.423067 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-30688cbd-6d8b-4b50-b7d7-e208fd61d976 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1218 microversion: 2.1 time: 0.090302 Jul 11 20:58:54.423633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 116/238] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:54 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:54.921224 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fdabbee2-377b-4c21-b698-13249cca3ff4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:54.921831 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fdabbee2-377b-4c21-b698-13249cca3ff4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:54.928654 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fdabbee2-377b-4c21-b698-13249cca3ff4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:54.929100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fdabbee2-377b-4c21-b698-13249cca3ff4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:54.929892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fdabbee2-377b-4c21-b698-13249cca3ff4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:54.930322 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fdabbee2-377b-4c21-b698-13249cca3ff4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:55.070419 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fdabbee2-377b-4c21-b698-13249cca3ff4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:55.079227 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fdabbee2-377b-4c21-b698-13249cca3ff4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.162912 Jul 11 20:58:55.079795 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 123/239] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:54 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:55.286115 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8bfa3bd2-7c09-497d-8efa-4690ea6b3576 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:55.286962 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8bfa3bd2-7c09-497d-8efa-4690ea6b3576 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:55.297238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8bfa3bd2-7c09-497d-8efa-4690ea6b3576 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:55.297963 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8bfa3bd2-7c09-497d-8efa-4690ea6b3576 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:55.299229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8bfa3bd2-7c09-497d-8efa-4690ea6b3576 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:55.299942 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8bfa3bd2-7c09-497d-8efa-4690ea6b3576 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:55.440709 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c373f9d7-484d-4ad3-854d-d457c6c1713f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:55.441437 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c373f9d7-484d-4ad3-854d-d457c6c1713f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:55.443432 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:55.448799 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c373f9d7-484d-4ad3-854d-d457c6c1713f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:55.448993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8bfa3bd2-7c09-497d-8efa-4690ea6b3576 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:55.449418 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c373f9d7-484d-4ad3-854d-d457c6c1713f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:55.450005 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c373f9d7-484d-4ad3-854d-d457c6c1713f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:55.450425 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c373f9d7-484d-4ad3-854d-d457c6c1713f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:55.457231 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8bfa3bd2-7c09-497d-8efa-4690ea6b3576 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.177740 Jul 11 20:58:55.458205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 117/240] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:55 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:55.512815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c373f9d7-484d-4ad3-854d-d457c6c1713f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:55.520478 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c373f9d7-484d-4ad3-854d-d457c6c1713f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1218 microversion: 2.1 time: 0.083698 Jul 11 20:58:55.521048 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 124/241] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:55 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:56.098018 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-766d9db9-fcc3-4dfd-96e3-9e941b1b44ef tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:56.099143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-766d9db9-fcc3-4dfd-96e3-9e941b1b44ef tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:56.107501 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-766d9db9-fcc3-4dfd-96e3-9e941b1b44ef tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:56.108062 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-766d9db9-fcc3-4dfd-96e3-9e941b1b44ef tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:56.109073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-766d9db9-fcc3-4dfd-96e3-9e941b1b44ef tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:56.109656 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-766d9db9-fcc3-4dfd-96e3-9e941b1b44ef tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:56.253008 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-766d9db9-fcc3-4dfd-96e3-9e941b1b44ef tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:56.261033 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-766d9db9-fcc3-4dfd-96e3-9e941b1b44ef tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.168340 Jul 11 20:58:56.261829 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 118/242] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:56 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:56.478843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d26574dd-719c-4ec3-93eb-435a6dcaafda tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:56.479865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d26574dd-719c-4ec3-93eb-435a6dcaafda tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:56.486807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d26574dd-719c-4ec3-93eb-435a6dcaafda tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:56.487274 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d26574dd-719c-4ec3-93eb-435a6dcaafda tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:56.488059 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d26574dd-719c-4ec3-93eb-435a6dcaafda tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:56.488533 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d26574dd-719c-4ec3-93eb-435a6dcaafda tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:56.537245 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ed7b7ac0-7658-43c7-9ed5-8e4eec5b58b2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:56.537857 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ed7b7ac0-7658-43c7-9ed5-8e4eec5b58b2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:56.544873 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed7b7ac0-7658-43c7-9ed5-8e4eec5b58b2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:56.545311 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed7b7ac0-7658-43c7-9ed5-8e4eec5b58b2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:56.546055 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed7b7ac0-7658-43c7-9ed5-8e4eec5b58b2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:56.546479 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed7b7ac0-7658-43c7-9ed5-8e4eec5b58b2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:56.606798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ed7b7ac0-7658-43c7-9ed5-8e4eec5b58b2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:56.614841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ed7b7ac0-7658-43c7-9ed5-8e4eec5b58b2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1218 microversion: 2.1 time: 0.081436 Jul 11 20:58:56.615414 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 119/243] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:56 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:56.625248 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d26574dd-719c-4ec3-93eb-435a6dcaafda tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:56.633759 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d26574dd-719c-4ec3-93eb-435a6dcaafda tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.161404 Jul 11 20:58:56.634366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 125/244] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:56 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:57.282999 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6e068ccd-3286-4065-a267-3c20f4b5832a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:57.283606 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6e068ccd-3286-4065-a267-3c20f4b5832a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:57.289839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e068ccd-3286-4065-a267-3c20f4b5832a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:57.290282 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e068ccd-3286-4065-a267-3c20f4b5832a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:57.291033 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e068ccd-3286-4065-a267-3c20f4b5832a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:57.291467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e068ccd-3286-4065-a267-3c20f4b5832a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:57.440401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6e068ccd-3286-4065-a267-3c20f4b5832a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:57.448218 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6e068ccd-3286-4065-a267-3c20f4b5832a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.169155 Jul 11 20:58:57.448794 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 120/245] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:57 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:57.632126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1df85cee-2cd4-4552-b825-72a697b07de4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:57.632735 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1df85cee-2cd4-4552-b825-72a697b07de4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:57.639582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1df85cee-2cd4-4552-b825-72a697b07de4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:57.639959 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1df85cee-2cd4-4552-b825-72a697b07de4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:57.640742 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1df85cee-2cd4-4552-b825-72a697b07de4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:57.641170 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1df85cee-2cd4-4552-b825-72a697b07de4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:57.652676 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5980cd39-22be-48f2-bd3e-cbda8ca3479a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:57.654593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5980cd39-22be-48f2-bd3e-cbda8ca3479a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:57.661897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5980cd39-22be-48f2-bd3e-cbda8ca3479a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:57.662780 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5980cd39-22be-48f2-bd3e-cbda8ca3479a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:57.663764 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5980cd39-22be-48f2-bd3e-cbda8ca3479a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:57.664430 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5980cd39-22be-48f2-bd3e-cbda8ca3479a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:57.669549 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:57.714826 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1df85cee-2cd4-4552-b825-72a697b07de4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:57.718885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:57.723734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1df85cee-2cd4-4552-b825-72a697b07de4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1266 microversion: 2.1 time: 0.095504 Jul 11 20:58:57.724538 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 126/246] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:57 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:57.825990 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5980cd39-22be-48f2-bd3e-cbda8ca3479a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:57.835267 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5980cd39-22be-48f2-bd3e-cbda8ca3479a tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1553 microversion: 2.1 time: 0.186824 Jul 11 20:58:57.841174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 121/247] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:57 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:57.864377 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-9900d388-fc4a-4071-bd29-22fd0fc561f1 req-22cf303c-94fa-4c6a-b5d0-0f0ad3ce410b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ba91b13-c6e9-4273-b62f-09daf6fa9052", "name": "network-vif-deleted", "tag": "d120ab5c-f331-4514-ab2f-aae660b85d36"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:57.877676 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9900d388-fc4a-4071-bd29-22fd0fc561f1 req-22cf303c-94fa-4c6a-b5d0-0f0ad3ce410b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:57.878170 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9900d388-fc4a-4071-bd29-22fd0fc561f1 req-22cf303c-94fa-4c6a-b5d0-0f0ad3ce410b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:57.894565 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-9900d388-fc4a-4071-bd29-22fd0fc561f1 req-22cf303c-94fa-4c6a-b5d0-0f0ad3ce410b service nova] Creating event network-vif-deleted:d120ab5c-f331-4514-ab2f-aae660b85d36 for instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 on hv-cinder-84902 Jul 11 20:58:57.902318 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-9900d388-fc4a-4071-bd29-22fd0fc561f1 req-22cf303c-94fa-4c6a-b5d0-0f0ad3ce410b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041640 Jul 11 20:58:57.903062 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 127/248] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:58:58.465249 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-81d303bb-6b83-47bc-8fc8-60bd5622d34c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:58.465833 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-81d303bb-6b83-47bc-8fc8-60bd5622d34c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:58.473009 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-81d303bb-6b83-47bc-8fc8-60bd5622d34c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:58.473440 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-81d303bb-6b83-47bc-8fc8-60bd5622d34c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:58.474384 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-81d303bb-6b83-47bc-8fc8-60bd5622d34c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:58.474957 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-81d303bb-6b83-47bc-8fc8-60bd5622d34c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:58.615790 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-81d303bb-6b83-47bc-8fc8-60bd5622d34c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:58.623377 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-81d303bb-6b83-47bc-8fc8-60bd5622d34c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.162041 Jul 11 20:58:58.623944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 122/249] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:58 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:58.743788 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e95dcf6d-5a0e-46ff-9a1f-fecd184f3cd4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:58.746525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e95dcf6d-5a0e-46ff-9a1f-fecd184f3cd4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:58.752978 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e95dcf6d-5a0e-46ff-9a1f-fecd184f3cd4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:58.753420 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e95dcf6d-5a0e-46ff-9a1f-fecd184f3cd4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:58.754164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e95dcf6d-5a0e-46ff-9a1f-fecd184f3cd4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:58.754600 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e95dcf6d-5a0e-46ff-9a1f-fecd184f3cd4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:58.853524 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:58.854755 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:58.879251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:58.879683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:58.887375 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:58.887844 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:58.948526 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:58.950073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:58.950810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lazy-loading 'fault' on Instance uuid 9ba91b13-c6e9-4273-b62f-09daf6fa9052 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 20:58:58.998055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e95dcf6d-5a0e-46ff-9a1f-fecd184f3cd4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:59.015126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e95dcf6d-5a0e-46ff-9a1f-fecd184f3cd4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.276751 Jul 11 20:58:59.016079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 128/250] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:58 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:59.017258 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5871ced3beb4decacc3a20afe523349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ba718dad487fa0f174b8b0964286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:59.033171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-556704ab-66ec-473f-8194-25f42ce24db0 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 200 len: 1350 microversion: 2.1 time: 0.184326 Jul 11 20:58:59.033761 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 123/251] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:58 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 1350 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:58:59.641019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6dc9eccf-f393-4dc2-b294-9fe646793764 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:58:59.641638 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6dc9eccf-f393-4dc2-b294-9fe646793764 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:58:59.648123 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6dc9eccf-f393-4dc2-b294-9fe646793764 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:59.648578 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6dc9eccf-f393-4dc2-b294-9fe646793764 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:59.649331 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6dc9eccf-f393-4dc2-b294-9fe646793764 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:59.649758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6dc9eccf-f393-4dc2-b294-9fe646793764 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:59.790573 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6dc9eccf-f393-4dc2-b294-9fe646793764 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:58:59.799280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6dc9eccf-f393-4dc2-b294-9fe646793764 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.162372 Jul 11 20:58:59.799863 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 129/252] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:58:59 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:58:59.925062 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-95e93950-cb25-43e9-a5cb-c07bf2cff952 req-d3633a3f-a483-479d-b74e-bdfa454eae63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "783d3937-6206-4ae4-aea0-8ba0106fadf0", "tag": "acf53b71-fcd7-4722-8fb3-02b088954e3b"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:58:59.938229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-95e93950-cb25-43e9-a5cb-c07bf2cff952 req-d3633a3f-a483-479d-b74e-bdfa454eae63 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:58:59.938663 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-95e93950-cb25-43e9-a5cb-c07bf2cff952 req-d3633a3f-a483-479d-b74e-bdfa454eae63 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:58:59.950214 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-95e93950-cb25-43e9-a5cb-c07bf2cff952 req-d3633a3f-a483-479d-b74e-bdfa454eae63 service nova] Creating event network-changed:acf53b71-fcd7-4722-8fb3-02b088954e3b for instance 783d3937-6206-4ae4-aea0-8ba0106fadf0 on hv-cinder-84902 Jul 11 20:58:59.955353 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-95e93950-cb25-43e9-a5cb-c07bf2cff952 req-d3633a3f-a483-479d-b74e-bdfa454eae63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037576 Jul 11 20:58:59.956180 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 124/253] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:59:00.032689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-320473d8-7584-4c89-880e-7e85bdae8339 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:00.033296 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-320473d8-7584-4c89-880e-7e85bdae8339 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:00.040012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-320473d8-7584-4c89-880e-7e85bdae8339 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:00.040499 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-320473d8-7584-4c89-880e-7e85bdae8339 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:00.041257 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-320473d8-7584-4c89-880e-7e85bdae8339 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:00.041694 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-320473d8-7584-4c89-880e-7e85bdae8339 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:00.051951 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:00.052666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:00.059677 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:00.060831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:00.061635 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:00.062074 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:00.076797 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] HTTP exception thrown: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Request method failure captured: Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 HTTP/1.1 Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI65DdppiW18OKdVJH9e4dQ9ONIr6w1Sst0qR-8SZP7gFjtYvrcc3peMzANJk6WvMeecye_T0zYJg1OhKdV_43Qf6WcD2aMuoW97ps_UOQgCcNZJ2fhFjPTZ7dags3e4wyukAe5k8YWEkaiCvEHz-mdLathyLinBqnllqE1huJutsK8 Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: dab2ba718dad487fa0f174b8b0964286 Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 20:59:00.081872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dab2ba718dad487fa0f174b8b0964286", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: dab2ba718dad487fa0f174b8b0964286 Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-DeleteServersTestJSON-1310814542-project Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: b5871ced3beb4decacc3a20afe523349 Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-DeleteServersTestJSON-1310814542-project Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.083336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '9ba91b13-c6e9-4273-b62f-09daf6fa9052'} Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:59:00.084076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.085298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.086434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Returning 404 to user: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:59:00.086434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d276885e-733b-4047-9e31-5ebe720c94a6 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 404 len: 111 microversion: 2.1 time: 0.035739 Jul 11 20:59:00.086434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 125/254] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:00 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 20:59:00.174912 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-320473d8-7584-4c89-880e-7e85bdae8339 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:00.183131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-320473d8-7584-4c89-880e-7e85bdae8339 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.154282 Jul 11 20:59:00.183692 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 130/255] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:00 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:00.190390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:00.191355 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:00.197514 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:00.197959 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:00.198705 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:00.199135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:00.212073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] HTTP exception thrown: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Request method failure captured: Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052/os-volume_attachments HTTP/1.1 Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI65DdppiW18OKdVJH9e4dQ9ONIr6w1Sst0qR-8SZP7gFjtYvrcc3peMzANJk6WvMeecye_T0zYJg1OhKdV_43Qf6WcD2aMuoW97ps_UOQgCcNZJ2fhFjPTZ7dags3e4wyukAe5k8YWEkaiCvEHz-mdLathyLinBqnllqE1huJutsK8 Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: dab2ba718dad487fa0f174b8b0964286 Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 20:59:00.214205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dab2ba718dad487fa0f174b8b0964286", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: dab2ba718dad487fa0f174b8b0964286 Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-DeleteServersTestJSON-1310814542-project Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: b5871ced3beb4decacc3a20afe523349 Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-DeleteServersTestJSON-1310814542-project Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.215604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'server_id': '9ba91b13-c6e9-4273-b62f-09daf6fa9052'} Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:59:00.216441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:00.217719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:00.218763 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Returning 404 to user: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:59:00.218763 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e4bc6e3e-a2d1-4487-8a4b-1d801605b154 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029228 Jul 11 20:59:00.218763 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 126/256] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 20:59:00 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 20:59:00.820589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cbff9685-bf9c-4994-907a-09e1058bf980 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:00.821179 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-cbff9685-bf9c-4994-907a-09e1058bf980 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:00.829378 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cbff9685-bf9c-4994-907a-09e1058bf980 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:00.829859 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cbff9685-bf9c-4994-907a-09e1058bf980 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:00.830630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cbff9685-bf9c-4994-907a-09e1058bf980 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:00.831062 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cbff9685-bf9c-4994-907a-09e1058bf980 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:00.973906 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-cbff9685-bf9c-4994-907a-09e1058bf980 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:00.981964 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-cbff9685-bf9c-4994-907a-09e1058bf980 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.165357 Jul 11 20:59:00.982663 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 131/257] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:00 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:01.204602 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-412759e6-dff9-4db9-82c1-c68627fd90e4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:01.205594 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-412759e6-dff9-4db9-82c1-c68627fd90e4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:01.209526 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:01.210605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:01.219429 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-412759e6-dff9-4db9-82c1-c68627fd90e4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:01.219876 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-412759e6-dff9-4db9-82c1-c68627fd90e4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:01.220667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-412759e6-dff9-4db9-82c1-c68627fd90e4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:01.221096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-412759e6-dff9-4db9-82c1-c68627fd90e4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:01.545469 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-412759e6-dff9-4db9-82c1-c68627fd90e4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:01.553306 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-412759e6-dff9-4db9-82c1-c68627fd90e4 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.355250 Jul 11 20:59:01.553879 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 127/258] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:01 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:02.003661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c105975e-b13d-443b-9980-5ee8fe97053c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:02.004595 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c105975e-b13d-443b-9980-5ee8fe97053c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:02.007754 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:02.017701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c105975e-b13d-443b-9980-5ee8fe97053c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:02.018449 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c105975e-b13d-443b-9980-5ee8fe97053c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:02.019715 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c105975e-b13d-443b-9980-5ee8fe97053c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:02.020532 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c105975e-b13d-443b-9980-5ee8fe97053c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:02.164370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c105975e-b13d-443b-9980-5ee8fe97053c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:02.172384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c105975e-b13d-443b-9980-5ee8fe97053c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.175616 Jul 11 20:59:02.172972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 132/259] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:01 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:02.575280 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-920a3245-042f-423c-a8c5-eda6c8bdd4e3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:02.576092 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-920a3245-042f-423c-a8c5-eda6c8bdd4e3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:02.583333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-920a3245-042f-423c-a8c5-eda6c8bdd4e3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:02.583801 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-920a3245-042f-423c-a8c5-eda6c8bdd4e3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:02.584632 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-920a3245-042f-423c-a8c5-eda6c8bdd4e3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:02.585082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-920a3245-042f-423c-a8c5-eda6c8bdd4e3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:02.729820 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-920a3245-042f-423c-a8c5-eda6c8bdd4e3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:02.738383 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-920a3245-042f-423c-a8c5-eda6c8bdd4e3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.169576 Jul 11 20:59:02.738945 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 128/260] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:02 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:03.191300 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8d6f2680-41fa-4dcf-889d-928d008cd7ab tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:03.192307 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8d6f2680-41fa-4dcf-889d-928d008cd7ab tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:03.201350 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8d6f2680-41fa-4dcf-889d-928d008cd7ab tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:03.201833 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8d6f2680-41fa-4dcf-889d-928d008cd7ab tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:03.202550 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8d6f2680-41fa-4dcf-889d-928d008cd7ab tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:03.202976 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8d6f2680-41fa-4dcf-889d-928d008cd7ab tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:03.336045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8d6f2680-41fa-4dcf-889d-928d008cd7ab tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:03.343835 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8d6f2680-41fa-4dcf-889d-928d008cd7ab tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.157352 Jul 11 20:59:03.344474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 133/261] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:03 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:03.756492 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-67f69ac0-3bcd-4ded-9d73-49a8c1749aec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:03.757237 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-67f69ac0-3bcd-4ded-9d73-49a8c1749aec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:03.765522 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67f69ac0-3bcd-4ded-9d73-49a8c1749aec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:03.765961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67f69ac0-3bcd-4ded-9d73-49a8c1749aec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:03.766717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67f69ac0-3bcd-4ded-9d73-49a8c1749aec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:03.767147 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67f69ac0-3bcd-4ded-9d73-49a8c1749aec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:03.928018 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-67f69ac0-3bcd-4ded-9d73-49a8c1749aec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:03.939412 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-67f69ac0-3bcd-4ded-9d73-49a8c1749aec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.187579 Jul 11 20:59:03.940129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 129/262] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:03 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:04.363167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e85073fd-aca3-4d51-86ec-790e3e063e70 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:04.364215 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e85073fd-aca3-4d51-86ec-790e3e063e70 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:04.370295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e85073fd-aca3-4d51-86ec-790e3e063e70 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:04.370798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e85073fd-aca3-4d51-86ec-790e3e063e70 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:04.371567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e85073fd-aca3-4d51-86ec-790e3e063e70 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:04.372249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e85073fd-aca3-4d51-86ec-790e3e063e70 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:04.814928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e85073fd-aca3-4d51-86ec-790e3e063e70 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:04.824750 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e85073fd-aca3-4d51-86ec-790e3e063e70 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.466281 Jul 11 20:59:04.825714 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 134/263] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:04 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:04.960794 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cc25e15e-c396-4191-816a-a3c22d44bb0f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:04.961374 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cc25e15e-c396-4191-816a-a3c22d44bb0f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:04.968440 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc25e15e-c396-4191-816a-a3c22d44bb0f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:04.968832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc25e15e-c396-4191-816a-a3c22d44bb0f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:04.969611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc25e15e-c396-4191-816a-a3c22d44bb0f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:04.970039 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc25e15e-c396-4191-816a-a3c22d44bb0f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:05.098991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cc25e15e-c396-4191-816a-a3c22d44bb0f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:05.107177 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cc25e15e-c396-4191-816a-a3c22d44bb0f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.150356 Jul 11 20:59:05.107749 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 130/264] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:04 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:05.844384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-294e8c07-42a6-44e4-9e7f-8cc9c23dbb08 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:05.844990 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-294e8c07-42a6-44e4-9e7f-8cc9c23dbb08 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:05.851492 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-294e8c07-42a6-44e4-9e7f-8cc9c23dbb08 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:05.851942 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-294e8c07-42a6-44e4-9e7f-8cc9c23dbb08 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:05.852744 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-294e8c07-42a6-44e4-9e7f-8cc9c23dbb08 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:05.853179 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-294e8c07-42a6-44e4-9e7f-8cc9c23dbb08 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:06.019007 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-294e8c07-42a6-44e4-9e7f-8cc9c23dbb08 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:06.030885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-294e8c07-42a6-44e4-9e7f-8cc9c23dbb08 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.191041 Jul 11 20:59:06.031679 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 135/265] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:05 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:06.128319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-aab05069-0f2c-4eec-aed3-484d63aa8b78 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:06.129345 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-aab05069-0f2c-4eec-aed3-484d63aa8b78 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:06.139731 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aab05069-0f2c-4eec-aed3-484d63aa8b78 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:06.140199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aab05069-0f2c-4eec-aed3-484d63aa8b78 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:06.140947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aab05069-0f2c-4eec-aed3-484d63aa8b78 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:06.141371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aab05069-0f2c-4eec-aed3-484d63aa8b78 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:06.297210 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-aab05069-0f2c-4eec-aed3-484d63aa8b78 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:06.308199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-aab05069-0f2c-4eec-aed3-484d63aa8b78 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.185636 Jul 11 20:59:06.309036 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 131/266] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:06 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:06.711877 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:06.711877 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:06.718380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:06.718958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:06.719718 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:06.720255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:06.879545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] HTTP exception thrown: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Request method failure captured: Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: DELETE /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 HTTP/1.1 Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI65DdppiW18OKdVJH9e4dQ9ONIr6w1Sst0qR-8SZP7gFjtYvrcc3peMzANJk6WvMeecye_T0zYJg1OhKdV_43Qf6WcD2aMuoW97ps_UOQgCcNZJ2fhFjPTZ7dags3e4wyukAe5k8YWEkaiCvEHz-mdLathyLinBqnllqE1huJutsK8 Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: dab2ba718dad487fa0f174b8b0964286 Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 20:59:06.884070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dab2ba718dad487fa0f174b8b0964286", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: dab2ba718dad487fa0f174b8b0964286 Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-DeleteServersTestJSON-1310814542-project Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: b5871ced3beb4decacc3a20afe523349 Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-DeleteServersTestJSON-1310814542-project Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.885405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '9ba91b13-c6e9-4273-b62f-09daf6fa9052'} Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:59:06.889146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.890701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.891966 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Returning 404 to user: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:59:06.891966 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-043e7555-69c1-4a75-9807-217cae7da177 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 404 len: 111 microversion: 2.1 time: 0.179097 Jul 11 20:59:06.891966 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 136/267] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 20:59:06 2022] DELETE /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 20:59:06.897172 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:06.897769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] [instance: 9ba91b13-c6e9-4273-b62f-09daf6fa9052] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:06.906952 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:06.907663 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:06.909338 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:06.910094 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:06.925177 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] HTTP exception thrown: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Request method failure captured: Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 HTTP/1.1 Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI65DdppiW18OKdVJH9e4dQ9ONIr6w1Sst0qR-8SZP7gFjtYvrcc3peMzANJk6WvMeecye_T0zYJg1OhKdV_43Qf6WcD2aMuoW97ps_UOQgCcNZJ2fhFjPTZ7dags3e4wyukAe5k8YWEkaiCvEHz-mdLathyLinBqnllqE1huJutsK8 Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: dab2ba718dad487fa0f174b8b0964286 Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 20:59:06.926703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2ba718dad487fa0f174b8b0964286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dab2ba718dad487fa0f174b8b0964286", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: dab2ba718dad487fa0f174b8b0964286 Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-DeleteServersTestJSON-1310814542 Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-DeleteServersTestJSON-1310814542-project Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: b5871ced3beb4decacc3a20afe523349 Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-DeleteServersTestJSON-1310814542-project Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.927998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '9ba91b13-c6e9-4273-b62f-09daf6fa9052'} Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:59:06.928778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. Jul 11 20:59:06.929998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:06.931553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] Returning 404 to user: Instance 9ba91b13-c6e9-4273-b62f-09daf6fa9052 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:59:06.931553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f78d8a17-c6c7-49a9-a6bf-efc0fdeeaa36 tempest-DeleteServersTestJSON-1310814542 tempest-DeleteServersTestJSON-1310814542-project] 10.222.0.20 "GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052" status: 404 len: 111 microversion: 2.1 time: 0.034741 Jul 11 20:59:06.938000 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 132/268] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:06 2022] GET /compute/v2.1/servers/9ba91b13-c6e9-4273-b62f-09daf6fa9052 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 20:59:07.053061 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5306666f-2479-4539-8216-c0fcb38da68f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:07.053660 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5306666f-2479-4539-8216-c0fcb38da68f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:07.060276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5306666f-2479-4539-8216-c0fcb38da68f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:07.060732 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5306666f-2479-4539-8216-c0fcb38da68f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:07.061478 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5306666f-2479-4539-8216-c0fcb38da68f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:07.061895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5306666f-2479-4539-8216-c0fcb38da68f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:07.294482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5306666f-2479-4539-8216-c0fcb38da68f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:07.302627 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5306666f-2479-4539-8216-c0fcb38da68f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.253432 Jul 11 20:59:07.303198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 137/269] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:07 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:07.324727 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bb7cb253-db21-4cce-a08b-f5e22ede84de tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:07.325328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bb7cb253-db21-4cce-a08b-f5e22ede84de tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:07.331995 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bb7cb253-db21-4cce-a08b-f5e22ede84de tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:07.332475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bb7cb253-db21-4cce-a08b-f5e22ede84de tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:07.333233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bb7cb253-db21-4cce-a08b-f5e22ede84de tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:07.333660 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bb7cb253-db21-4cce-a08b-f5e22ede84de tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:07.465263 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bb7cb253-db21-4cce-a08b-f5e22ede84de tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:07.473242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bb7cb253-db21-4cce-a08b-f5e22ede84de tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.152390 Jul 11 20:59:07.473818 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 133/270] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:07 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:08.320359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ff10b7ce-0f7d-4fda-8a8a-44f0ee762314 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:08.320980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ff10b7ce-0f7d-4fda-8a8a-44f0ee762314 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:08.328078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff10b7ce-0f7d-4fda-8a8a-44f0ee762314 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:08.328558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff10b7ce-0f7d-4fda-8a8a-44f0ee762314 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:08.329331 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff10b7ce-0f7d-4fda-8a8a-44f0ee762314 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:08.329767 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ff10b7ce-0f7d-4fda-8a8a-44f0ee762314 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:08.490341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8f848a18-bf53-44ef-8d5f-56eda697d090 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:08.490939 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8f848a18-bf53-44ef-8d5f-56eda697d090 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:08.498076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8f848a18-bf53-44ef-8d5f-56eda697d090 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:08.498371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8f848a18-bf53-44ef-8d5f-56eda697d090 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:08.499146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8f848a18-bf53-44ef-8d5f-56eda697d090 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:08.499572 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8f848a18-bf53-44ef-8d5f-56eda697d090 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:08.641822 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8f848a18-bf53-44ef-8d5f-56eda697d090 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:08.650014 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8f848a18-bf53-44ef-8d5f-56eda697d090 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.163505 Jul 11 20:59:08.650593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 134/271] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:08 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:08.768132 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ff10b7ce-0f7d-4fda-8a8a-44f0ee762314 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:08.776418 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ff10b7ce-0f7d-4fda-8a8a-44f0ee762314 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.460750 Jul 11 20:59:08.776994 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 138/272] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:08 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:09.673005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-158cdf15-f04a-4a4e-ba68-5b377c736e9c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:09.673779 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-158cdf15-f04a-4a4e-ba68-5b377c736e9c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:09.682086 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-158cdf15-f04a-4a4e-ba68-5b377c736e9c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:09.682504 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-158cdf15-f04a-4a4e-ba68-5b377c736e9c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:09.683454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-158cdf15-f04a-4a4e-ba68-5b377c736e9c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:09.685476 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-158cdf15-f04a-4a4e-ba68-5b377c736e9c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:09.795075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b1a7e894-cbc8-4e41-b610-2621c3f40317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:09.795685 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b1a7e894-cbc8-4e41-b610-2621c3f40317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:09.803239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b1a7e894-cbc8-4e41-b610-2621c3f40317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:09.803689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b1a7e894-cbc8-4e41-b610-2621c3f40317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:09.804493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b1a7e894-cbc8-4e41-b610-2621c3f40317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:09.804924 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b1a7e894-cbc8-4e41-b610-2621c3f40317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:09.924870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-158cdf15-f04a-4a4e-ba68-5b377c736e9c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:09.934444 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-158cdf15-f04a-4a4e-ba68-5b377c736e9c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.271000 Jul 11 20:59:09.944581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 135/273] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:09 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:09.949017 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b1a7e894-cbc8-4e41-b610-2621c3f40317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:09.957426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b1a7e894-cbc8-4e41-b610-2621c3f40317 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.166353 Jul 11 20:59:09.958001 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 139/274] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:09 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:10.951016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6741698c-0381-4f86-b41b-0e8a2e19ca15 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:10.951590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6741698c-0381-4f86-b41b-0e8a2e19ca15 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:10.960647 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6741698c-0381-4f86-b41b-0e8a2e19ca15 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:10.961296 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6741698c-0381-4f86-b41b-0e8a2e19ca15 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:10.962362 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6741698c-0381-4f86-b41b-0e8a2e19ca15 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:10.962897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6741698c-0381-4f86-b41b-0e8a2e19ca15 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:10.974169 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-dbec4595-0411-4cb4-90b3-249c07018232 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:10.974754 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-dbec4595-0411-4cb4-90b3-249c07018232 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:10.981101 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dbec4595-0411-4cb4-90b3-249c07018232 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:10.981608 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dbec4595-0411-4cb4-90b3-249c07018232 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:10.982374 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dbec4595-0411-4cb4-90b3-249c07018232 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:10.982824 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dbec4595-0411-4cb4-90b3-249c07018232 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:11.101169 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6741698c-0381-4f86-b41b-0e8a2e19ca15 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:11.109449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6741698c-0381-4f86-b41b-0e8a2e19ca15 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.162136 Jul 11 20:59:11.110067 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 136/275] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:10 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:11.158281 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-dbec4595-0411-4cb4-90b3-249c07018232 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:11.165995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-dbec4595-0411-4cb4-90b3-249c07018232 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.195600 Jul 11 20:59:11.166772 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 140/276] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:10 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:12.127322 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-868b7760-ae44-470b-9682-01670f50fca5 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:12.127907 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-868b7760-ae44-470b-9682-01670f50fca5 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:12.136221 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-868b7760-ae44-470b-9682-01670f50fca5 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:12.136960 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-868b7760-ae44-470b-9682-01670f50fca5 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:12.138068 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-868b7760-ae44-470b-9682-01670f50fca5 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:12.138875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-868b7760-ae44-470b-9682-01670f50fca5 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:12.184975 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c0bb35c2-78b8-4dd1-8894-5ebcccf6384a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:12.185779 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c0bb35c2-78b8-4dd1-8894-5ebcccf6384a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:12.194624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c0bb35c2-78b8-4dd1-8894-5ebcccf6384a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:12.195078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c0bb35c2-78b8-4dd1-8894-5ebcccf6384a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:12.196081 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c0bb35c2-78b8-4dd1-8894-5ebcccf6384a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:12.197796 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c0bb35c2-78b8-4dd1-8894-5ebcccf6384a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:12.335019 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-868b7760-ae44-470b-9682-01670f50fca5 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:12.344554 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-868b7760-ae44-470b-9682-01670f50fca5 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.222185 Jul 11 20:59:12.352808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 137/277] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:12 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:12.384601 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c0bb35c2-78b8-4dd1-8894-5ebcccf6384a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:12.394928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c0bb35c2-78b8-4dd1-8894-5ebcccf6384a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.215703 Jul 11 20:59:12.395706 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 141/278] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:12 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:12.809768 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-1c73046e-3a17-4034-b5b8-7cbf89109a13 req-908160ba-95f2-47bb-84fb-a147db589bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "783d3937-6206-4ae4-aea0-8ba0106fadf0", "name": "network-vif-plugged", "status": "completed", "tag": "acf53b71-fcd7-4722-8fb3-02b088954e3b"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:12.819417 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-1c73046e-3a17-4034-b5b8-7cbf89109a13 req-908160ba-95f2-47bb-84fb-a147db589bc5 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:12.820171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-1c73046e-3a17-4034-b5b8-7cbf89109a13 req-908160ba-95f2-47bb-84fb-a147db589bc5 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:12.834993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-1c73046e-3a17-4034-b5b8-7cbf89109a13 req-908160ba-95f2-47bb-84fb-a147db589bc5 service nova] Creating event network-vif-plugged:acf53b71-fcd7-4722-8fb3-02b088954e3b for instance 783d3937-6206-4ae4-aea0-8ba0106fadf0 on hv-cinder-84902 Jul 11 20:59:12.840547 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-1c73046e-3a17-4034-b5b8-7cbf89109a13 req-908160ba-95f2-47bb-84fb-a147db589bc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035038 Jul 11 20:59:12.841498 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 138/279] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:59:13.363052 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0c7c5fd2-a223-4d93-b2ef-7b66e86bc5be tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:13.363653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0c7c5fd2-a223-4d93-b2ef-7b66e86bc5be tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:13.371537 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0c7c5fd2-a223-4d93-b2ef-7b66e86bc5be tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:13.372149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0c7c5fd2-a223-4d93-b2ef-7b66e86bc5be tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:13.372857 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0c7c5fd2-a223-4d93-b2ef-7b66e86bc5be tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:13.373273 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0c7c5fd2-a223-4d93-b2ef-7b66e86bc5be tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:13.413343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-3c278fbf-c39f-4757-9e09-de462ffabe71 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:13.413917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-3c278fbf-c39f-4757-9e09-de462ffabe71 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:13.421302 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3c278fbf-c39f-4757-9e09-de462ffabe71 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:13.421741 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3c278fbf-c39f-4757-9e09-de462ffabe71 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:13.422505 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3c278fbf-c39f-4757-9e09-de462ffabe71 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:13.422930 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3c278fbf-c39f-4757-9e09-de462ffabe71 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:13.508387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0c7c5fd2-a223-4d93-b2ef-7b66e86bc5be tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:13.517663 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0c7c5fd2-a223-4d93-b2ef-7b66e86bc5be tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.158591 Jul 11 20:59:13.518568 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 142/280] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:13 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:13.583928 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3c278fbf-c39f-4757-9e09-de462ffabe71 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:13.592879 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-3c278fbf-c39f-4757-9e09-de462ffabe71 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1521 microversion: 2.1 time: 0.184228 Jul 11 20:59:13.593456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 139/281] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:13 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:14.535001 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-16071250-8e77-4d4d-acfe-8833240c1558 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:14.536528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-16071250-8e77-4d4d-acfe-8833240c1558 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:14.542805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-16071250-8e77-4d4d-acfe-8833240c1558 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:14.543333 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-16071250-8e77-4d4d-acfe-8833240c1558 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:14.544238 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-16071250-8e77-4d4d-acfe-8833240c1558 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:14.544882 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-16071250-8e77-4d4d-acfe-8833240c1558 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:14.612421 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c56dfc4f-1491-4696-a3c1-01eff6b4fc6e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:14.613143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c56dfc4f-1491-4696-a3c1-01eff6b4fc6e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:14.620443 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c56dfc4f-1491-4696-a3c1-01eff6b4fc6e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:14.621237 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c56dfc4f-1491-4696-a3c1-01eff6b4fc6e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:14.622167 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c56dfc4f-1491-4696-a3c1-01eff6b4fc6e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:14.622766 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c56dfc4f-1491-4696-a3c1-01eff6b4fc6e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:14.696557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-16071250-8e77-4d4d-acfe-8833240c1558 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:14.705662 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-16071250-8e77-4d4d-acfe-8833240c1558 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.174635 Jul 11 20:59:14.706321 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 143/282] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:14 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:14.774405 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c56dfc4f-1491-4696-a3c1-01eff6b4fc6e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:14.779286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:14.785137 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c56dfc4f-1491-4696-a3c1-01eff6b4fc6e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1501 microversion: 2.1 time: 0.179330 Jul 11 20:59:14.796696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 140/283] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:14 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:14.801409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f4b0dfde-06f3-4b4e-ac25-fa92beebabf5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:14.803717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f4b0dfde-06f3-4b4e-ac25-fa92beebabf5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:14.810212 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f4b0dfde-06f3-4b4e-ac25-fa92beebabf5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:14.810891 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f4b0dfde-06f3-4b4e-ac25-fa92beebabf5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:14.811834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f4b0dfde-06f3-4b4e-ac25-fa92beebabf5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:14.812769 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f4b0dfde-06f3-4b4e-ac25-fa92beebabf5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:14.951090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f4b0dfde-06f3-4b4e-ac25-fa92beebabf5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:14.955615 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=100 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:14.962357 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f4b0dfde-06f3-4b4e-ac25-fa92beebabf5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1514 microversion: 2.1 time: 0.164594 Jul 11 20:59:14.963123 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 144/284] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:14 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:15.722055 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e8f9b37a-6114-4862-99a4-9d43227f89cf tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:15.722679 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e8f9b37a-6114-4862-99a4-9d43227f89cf tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:15.730005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e8f9b37a-6114-4862-99a4-9d43227f89cf tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:15.730453 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e8f9b37a-6114-4862-99a4-9d43227f89cf tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:15.731202 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e8f9b37a-6114-4862-99a4-9d43227f89cf tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:15.731664 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e8f9b37a-6114-4862-99a4-9d43227f89cf tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:15.886486 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e8f9b37a-6114-4862-99a4-9d43227f89cf tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:15.902566 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e8f9b37a-6114-4862-99a4-9d43227f89cf tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1314 microversion: 2.1 time: 0.184284 Jul 11 20:59:15.915968 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 141/285] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:15 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:16.340856 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-39375985-152a-4e8d-9de3-a757b972a774 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:16.341918 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-39375985-152a-4e8d-9de3-a757b972a774 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:16.348045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-39375985-152a-4e8d-9de3-a757b972a774 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:16.348549 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-39375985-152a-4e8d-9de3-a757b972a774 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:16.349281 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-39375985-152a-4e8d-9de3-a757b972a774 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:16.349716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-39375985-152a-4e8d-9de3-a757b972a774 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:16.373959 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-39375985-152a-4e8d-9de3-a757b972a774 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lazy-loading 'flavor' on Instance uuid d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 20:59:16.464561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-39375985-152a-4e8d-9de3-a757b972a774 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591/action" status: 200 len: 32 microversion: 2.1 time: 0.127782 Jul 11 20:59:16.465514 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 145/286] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 20:59:16 2022] POST /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591/action => generated 32 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 20:59:16.476007 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-569304f2-3549-481a-8596-062fd809c3f1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:16.477039 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-569304f2-3549-481a-8596-062fd809c3f1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:16.485091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-569304f2-3549-481a-8596-062fd809c3f1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:16.485837 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-569304f2-3549-481a-8596-062fd809c3f1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:16.486792 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-569304f2-3549-481a-8596-062fd809c3f1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:16.487110 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-569304f2-3549-481a-8596-062fd809c3f1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:16.628721 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-569304f2-3549-481a-8596-062fd809c3f1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:16.636436 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-569304f2-3549-481a-8596-062fd809c3f1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.165117 Jul 11 20:59:16.637017 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 142/287] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:16 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:16.921898 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ad3bffb3-806a-497b-9f2e-d1664dfde776 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:16.922822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ad3bffb3-806a-497b-9f2e-d1664dfde776 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:16.933210 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad3bffb3-806a-497b-9f2e-d1664dfde776 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:16.933928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad3bffb3-806a-497b-9f2e-d1664dfde776 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:16.935433 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad3bffb3-806a-497b-9f2e-d1664dfde776 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:16.936496 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad3bffb3-806a-497b-9f2e-d1664dfde776 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:17.197504 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ad3bffb3-806a-497b-9f2e-d1664dfde776 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:17.205522 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ad3bffb3-806a-497b-9f2e-d1664dfde776 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1498 microversion: 2.1 time: 0.289609 Jul 11 20:59:17.206108 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 146/288] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:16 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1498 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:17.653902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-171af1bf-8062-4949-b646-a2ce782333da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:17.654484 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-171af1bf-8062-4949-b646-a2ce782333da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:17.662259 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-171af1bf-8062-4949-b646-a2ce782333da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:17.662769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-171af1bf-8062-4949-b646-a2ce782333da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:17.663842 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-171af1bf-8062-4949-b646-a2ce782333da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:17.664299 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-171af1bf-8062-4949-b646-a2ce782333da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:17.743545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b474f73d-33f8-4add-96c8-ac5cb5a5364f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:17.744175 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b474f73d-33f8-4add-96c8-ac5cb5a5364f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:17.754834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b474f73d-33f8-4add-96c8-ac5cb5a5364f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:17.755282 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b474f73d-33f8-4add-96c8-ac5cb5a5364f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:17.756049 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b474f73d-33f8-4add-96c8-ac5cb5a5364f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:17.756588 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b474f73d-33f8-4add-96c8-ac5cb5a5364f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:17.781930 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b474f73d-33f8-4add-96c8-ac5cb5a5364f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 20:59:17.827828 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-171af1bf-8062-4949-b646-a2ce782333da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:17.841021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-171af1bf-8062-4949-b646-a2ce782333da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.190844 Jul 11 20:59:17.841378 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 143/289] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:17 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:17.868438 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b474f73d-33f8-4add-96c8-ac5cb5a5364f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "DELETE /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 204 len: 0 microversion: 2.1 time: 0.128660 Jul 11 20:59:17.869121 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 147/290] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 20:59:17 2022] DELETE /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 20:59:17.878811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-248a831a-8e47-4cca-9ded-f01aca9cb026 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:17.879552 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-248a831a-8e47-4cca-9ded-f01aca9cb026 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:17.885641 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-248a831a-8e47-4cca-9ded-f01aca9cb026 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:17.886084 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-248a831a-8e47-4cca-9ded-f01aca9cb026 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:17.886830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-248a831a-8e47-4cca-9ded-f01aca9cb026 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:17.887256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-248a831a-8e47-4cca-9ded-f01aca9cb026 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:18.017160 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-248a831a-8e47-4cca-9ded-f01aca9cb026 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:18.024865 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-248a831a-8e47-4cca-9ded-f01aca9cb026 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1504 microversion: 2.1 time: 0.151258 Jul 11 20:59:18.025405 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 144/291] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:17 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:18.858485 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-98683cb5-f8e2-46d9-b778-94b3536aaa6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:18.859203 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-98683cb5-f8e2-46d9-b778-94b3536aaa6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:18.867497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-98683cb5-f8e2-46d9-b778-94b3536aaa6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:18.868172 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-98683cb5-f8e2-46d9-b778-94b3536aaa6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:18.869368 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-98683cb5-f8e2-46d9-b778-94b3536aaa6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:18.870089 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-98683cb5-f8e2-46d9-b778-94b3536aaa6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:19.019150 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-98683cb5-f8e2-46d9-b778-94b3536aaa6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:19.027358 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-98683cb5-f8e2-46d9-b778-94b3536aaa6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.173449 Jul 11 20:59:19.028023 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 148/292] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:18 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:19.041686 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-09431e37-abfe-4d5c-8604-180e8b19db22 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:19.042654 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-09431e37-abfe-4d5c-8604-180e8b19db22 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:19.050566 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-09431e37-abfe-4d5c-8604-180e8b19db22 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:19.051036 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-09431e37-abfe-4d5c-8604-180e8b19db22 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:19.051861 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-09431e37-abfe-4d5c-8604-180e8b19db22 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:19.052347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-09431e37-abfe-4d5c-8604-180e8b19db22 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:19.234983 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-09431e37-abfe-4d5c-8604-180e8b19db22 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:19.249232 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-09431e37-abfe-4d5c-8604-180e8b19db22 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1504 microversion: 2.1 time: 0.212168 Jul 11 20:59:19.250129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 145/293] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:19 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:20.046880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-74a8e2a9-3615-43b5-90ff-badd14c73c8f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:20.048020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-74a8e2a9-3615-43b5-90ff-badd14c73c8f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:20.054173 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74a8e2a9-3615-43b5-90ff-badd14c73c8f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:20.054626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74a8e2a9-3615-43b5-90ff-badd14c73c8f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:20.055387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74a8e2a9-3615-43b5-90ff-badd14c73c8f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:20.056198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74a8e2a9-3615-43b5-90ff-badd14c73c8f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:20.213290 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-3488bb8e-aa5e-4f38-9a7d-8bab46d8c189 req-a5b941c8-5bb3-4d22-b274-969f8eb1d8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "783d3937-6206-4ae4-aea0-8ba0106fadf0", "name": "network-vif-deleted", "tag": "acf53b71-fcd7-4722-8fb3-02b088954e3b"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:20.221629 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:20.228144 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-3488bb8e-aa5e-4f38-9a7d-8bab46d8c189 req-a5b941c8-5bb3-4d22-b274-969f8eb1d8b4 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:20.228803 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-3488bb8e-aa5e-4f38-9a7d-8bab46d8c189 req-a5b941c8-5bb3-4d22-b274-969f8eb1d8b4 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:20.272456 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-74a8e2a9-3615-43b5-90ff-badd14c73c8f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:20.281987 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-74a8e2a9-3615-43b5-90ff-badd14c73c8f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.239518 Jul 11 20:59:20.282842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 149/294] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:20 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:20.288851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6a742bfb-43c2-45af-8d26-6a8439ba4e23 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:20.290032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6a742bfb-43c2-45af-8d26-6a8439ba4e23 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:20.297522 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a742bfb-43c2-45af-8d26-6a8439ba4e23 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:20.298137 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a742bfb-43c2-45af-8d26-6a8439ba4e23 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:20.299049 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a742bfb-43c2-45af-8d26-6a8439ba4e23 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:20.299589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a742bfb-43c2-45af-8d26-6a8439ba4e23 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:20.375812 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6a742bfb-43c2-45af-8d26-6a8439ba4e23 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:20.386093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6a742bfb-43c2-45af-8d26-6a8439ba4e23 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1462 microversion: 2.1 time: 0.101871 Jul 11 20:59:20.386761 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 150/295] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:20 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1462 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:20.396902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-3488bb8e-aa5e-4f38-9a7d-8bab46d8c189 req-a5b941c8-5bb3-4d22-b274-969f8eb1d8b4 service nova] Creating event network-vif-deleted:acf53b71-fcd7-4722-8fb3-02b088954e3b for instance 783d3937-6206-4ae4-aea0-8ba0106fadf0 on hv-cinder-84902 Jul 11 20:59:20.398443 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-3488bb8e-aa5e-4f38-9a7d-8bab46d8c189 req-a5b941c8-5bb3-4d22-b274-969f8eb1d8b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189796 Jul 11 20:59:20.399325 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 146/296] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 20:59:21.304466 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4db513a3-88d3-40d4-b26a-92dbca4b4b18 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:21.305790 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4db513a3-88d3-40d4-b26a-92dbca4b4b18 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:21.317065 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4db513a3-88d3-40d4-b26a-92dbca4b4b18 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:21.317805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4db513a3-88d3-40d4-b26a-92dbca4b4b18 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:21.319072 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4db513a3-88d3-40d4-b26a-92dbca4b4b18 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:21.319804 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4db513a3-88d3-40d4-b26a-92dbca4b4b18 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:21.403498 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:21.404233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:21.411414 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:21.411855 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:21.412627 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:21.413083 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:21.445089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:21.445518 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:21.445960 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lazy-loading 'fault' on Instance uuid 783d3937-6206-4ae4-aea0-8ba0106fadf0 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 20:59:21.459850 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4db513a3-88d3-40d4-b26a-92dbca4b4b18 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:21.467707 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4db513a3-88d3-40d4-b26a-92dbca4b4b18 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.169719 Jul 11 20:59:21.468316 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 151/297] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:21 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:21.489402 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:21.497018 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0264ed24-f908-4d77-99e5-f38e0bd731ff tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1304 microversion: 2.1 time: 0.097784 Jul 11 20:59:21.497600 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 147/298] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:21 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:22.488711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2eca8aa8-6da4-4f2d-bbf1-efd99c03fc79 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:22.489680 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2eca8aa8-6da4-4f2d-bbf1-efd99c03fc79 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:22.500037 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2eca8aa8-6da4-4f2d-bbf1-efd99c03fc79 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:22.500838 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2eca8aa8-6da4-4f2d-bbf1-efd99c03fc79 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:22.502094 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2eca8aa8-6da4-4f2d-bbf1-efd99c03fc79 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:22.502813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2eca8aa8-6da4-4f2d-bbf1-efd99c03fc79 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:22.516302 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:22.517053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:22.524075 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:22.524558 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:22.525351 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:22.525778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:22.558142 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:22.558580 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:22.559016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lazy-loading 'fault' on Instance uuid 783d3937-6206-4ae4-aea0-8ba0106fadf0 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 20:59:22.603932 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:22.613286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fd5d3a30-9605-4b42-9b39-5cfd6a151a01 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1304 microversion: 2.1 time: 0.102356 Jul 11 20:59:22.613877 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 148/299] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:22 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:22.644873 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2eca8aa8-6da4-4f2d-bbf1-efd99c03fc79 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:22.654072 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2eca8aa8-6da4-4f2d-bbf1-efd99c03fc79 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.172000 Jul 11 20:59:22.654681 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 152/300] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:22 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:23.631685 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:23.632329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:23.639635 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:23.640088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:23.640890 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:23.641319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:23.670978 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e141e6cf-d847-4b94-95cd-21bc0a206bc6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:23.671574 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e141e6cf-d847-4b94-95cd-21bc0a206bc6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:23.672220 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:23.672664 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:23.673099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lazy-loading 'fault' on Instance uuid 783d3937-6206-4ae4-aea0-8ba0106fadf0 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 20:59:23.678426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e141e6cf-d847-4b94-95cd-21bc0a206bc6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:23.678870 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e141e6cf-d847-4b94-95cd-21bc0a206bc6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:23.679622 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e141e6cf-d847-4b94-95cd-21bc0a206bc6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:23.680051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e141e6cf-d847-4b94-95cd-21bc0a206bc6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:23.715352 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:23.723204 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-da128d96-7665-498b-b06d-2de9716195e1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 200 len: 1304 microversion: 2.1 time: 0.095430 Jul 11 20:59:23.724151 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 149/301] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:23 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:23.812652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e141e6cf-d847-4b94-95cd-21bc0a206bc6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:23.820320 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e141e6cf-d847-4b94-95cd-21bc0a206bc6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.153147 Jul 11 20:59:23.820882 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 153/302] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:23 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:24.744771 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:24.745749 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 783d3937-6206-4ae4-aea0-8ba0106fadf0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:24.754692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:24.755139 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:24.755902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:24.756367 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:24.770313 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] HTTP exception thrown: Instance 783d3937-6206-4ae4-aea0-8ba0106fadf0 could not be found. Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Request method failure captured: Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 HTTP/1.1 Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI8DwaTQqvUST5ym9P0NNmaokf2bSgNQV4mg0rtUSS8m214rrXKWOLHTsuT3eWCdUZvTscNxqXFVxtCv7Oi7-vNpPMh8Gfelf3jRIgQtU8YqFAQwi7hTFIn0vxAqIyoPSG3mTwyR_2v1wqpR6uHfwrIdO3Sh3vXh-_AfKsWYSu874Dc Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 804c8a0ad1674b818f8bbc53d661284b Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-VolumesActionsTest-417731331 Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 20:59:24.772294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/804c8a0ad1674b818f8bbc53d661284b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/804c8a0ad1674b818f8bbc53d661284b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/804c8a0ad1674b818f8bbc53d661284b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_804c8a0ad1674b818f8bbc53d661284b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-VolumesActionsTest-417731331 Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 804c8a0ad1674b818f8bbc53d661284b Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-VolumesActionsTest-417731331 Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-VolumesActionsTest-417731331-project Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 934b314c46824d5397a0ae92bb07b725 Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-VolumesActionsTest-417731331-project Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 783d3937-6206-4ae4-aea0-8ba0106fadf0 could not be found. Jul 11 20:59:24.773753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '783d3937-6206-4ae4-aea0-8ba0106fadf0'} Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 783d3937-6206-4ae4-aea0-8ba0106fadf0 could not be found. Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:59:24.774461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 783d3937-6206-4ae4-aea0-8ba0106fadf0 could not be found. Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 783d3937-6206-4ae4-aea0-8ba0106fadf0 could not be found. Jul 11 20:59:24.775533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:24.776538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Returning 404 to user: Instance 783d3937-6206-4ae4-aea0-8ba0106fadf0 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:59:24.776538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2f9fae9f-a7c6-4ded-aa7b-883fbccde72c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0" status: 404 len: 111 microversion: 2.1 time: 0.035840 Jul 11 20:59:24.776538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 150/303] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:24 2022] GET /compute/v2.1/servers/783d3937-6206-4ae4-aea0-8ba0106fadf0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 20:59:24.840934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-99fc0010-55e1-4e84-815d-ce1ab6e12aa9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:24.842169 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-99fc0010-55e1-4e84-815d-ce1ab6e12aa9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:24.848496 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-99fc0010-55e1-4e84-815d-ce1ab6e12aa9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:24.848956 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-99fc0010-55e1-4e84-815d-ce1ab6e12aa9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:24.849850 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-99fc0010-55e1-4e84-815d-ce1ab6e12aa9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:24.850302 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-99fc0010-55e1-4e84-815d-ce1ab6e12aa9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:24.890907 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1749414549", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "networks": [{"uuid": "eebfd3c1-d32f-4bbf-85c2-74848e36804e"}]}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:24.943231 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] validate_networks() for [('eebfd3c1-d32f-4bbf-85c2-74848e36804e', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 20:59:24.987794 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-99fc0010-55e1-4e84-815d-ce1ab6e12aa9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:24.996184 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-99fc0010-55e1-4e84-815d-ce1ab6e12aa9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.161029 Jul 11 20:59:24.997336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 154/304] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:24 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:25.524695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 20:59:25.525149 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 20:59:25.525776 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 20:59:25.526311 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 20:59:25.527014 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 20:59:25.536705 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:25.537150 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:25.537939 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:25.538369 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:25.555169 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Getting quotas for project 804c8a0ad1674b818f8bbc53d661284b. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:59:25.559549 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Getting quotas for user 934b314c46824d5397a0ae92bb07b725 and project 804c8a0ad1674b818f8bbc53d661284b. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:59:25.571514 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 20:59:25.573840 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 20:59:25.627105 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-909cce59-aaa4-487e-b170-3035e07adce8 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740009 Jul 11 20:59:25.627928 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 151/305] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 20:59:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 20:59:25.638095 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c0db18cb-f89a-4533-9b30-7475e2886892 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:25.638699 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c0db18cb-f89a-4533-9b30-7475e2886892 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:25.640759 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:25.697977 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c0db18cb-f89a-4533-9b30-7475e2886892 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:25.705005 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c0db18cb-f89a-4533-9b30-7475e2886892 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1214 microversion: 2.1 time: 0.070866 Jul 11 20:59:25.705617 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 155/306] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:25 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:26.014019 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c6adfc84-33f1-44df-8429-efcd3c82118b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:26.014617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c6adfc84-33f1-44df-8429-efcd3c82118b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:26.022989 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c6adfc84-33f1-44df-8429-efcd3c82118b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:26.023449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c6adfc84-33f1-44df-8429-efcd3c82118b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:26.024252 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c6adfc84-33f1-44df-8429-efcd3c82118b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:26.024694 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c6adfc84-33f1-44df-8429-efcd3c82118b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:26.170815 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c6adfc84-33f1-44df-8429-efcd3c82118b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:26.179673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c6adfc84-33f1-44df-8429-efcd3c82118b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.169777 Jul 11 20:59:26.180243 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 152/307] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:26 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:26.721651 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c551739a-058f-40f2-be25-d809743d2f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:26.722216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c551739a-058f-40f2-be25-d809743d2f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:26.729070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c551739a-058f-40f2-be25-d809743d2f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:26.729433 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c551739a-058f-40f2-be25-d809743d2f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:26.730208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c551739a-058f-40f2-be25-d809743d2f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:26.730635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c551739a-058f-40f2-be25-d809743d2f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:26.802769 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c551739a-058f-40f2-be25-d809743d2f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:26.811353 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c551739a-058f-40f2-be25-d809743d2f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1274 microversion: 2.1 time: 0.093655 Jul 11 20:59:26.811914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 156/308] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:26 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:27.197717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6381912a-f812-40f4-bb08-47c29904cc80 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:27.198314 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6381912a-f812-40f4-bb08-47c29904cc80 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:27.204858 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6381912a-f812-40f4-bb08-47c29904cc80 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:27.205270 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6381912a-f812-40f4-bb08-47c29904cc80 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:27.206024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6381912a-f812-40f4-bb08-47c29904cc80 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:27.206448 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6381912a-f812-40f4-bb08-47c29904cc80 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:27.347745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6381912a-f812-40f4-bb08-47c29904cc80 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:27.360032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6381912a-f812-40f4-bb08-47c29904cc80 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.166434 Jul 11 20:59:27.361317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 153/309] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:27 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:27.828955 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-66d47703-a85e-4276-9fe7-6f9a928f96d2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:27.829510 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-66d47703-a85e-4276-9fe7-6f9a928f96d2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:27.836286 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66d47703-a85e-4276-9fe7-6f9a928f96d2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:27.836731 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66d47703-a85e-4276-9fe7-6f9a928f96d2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:27.837568 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66d47703-a85e-4276-9fe7-6f9a928f96d2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:27.838041 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66d47703-a85e-4276-9fe7-6f9a928f96d2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:28.063154 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-66d47703-a85e-4276-9fe7-6f9a928f96d2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:28.071500 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-66d47703-a85e-4276-9fe7-6f9a928f96d2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.246536 Jul 11 20:59:28.072101 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 157/310] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:27 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:28.205329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-bf34a237-363d-4e9c-9b20-970bfeb2aba1 req-15597f7a-3dd8-453c-8cce-cda4df51bf10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e97b6da-f518-4292-9d9e-b99d27678b64", "tag": "2c8b9b30-30ba-41ff-ac60-05b114ba25ae"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:28.214669 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-bf34a237-363d-4e9c-9b20-970bfeb2aba1 req-15597f7a-3dd8-453c-8cce-cda4df51bf10 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:28.215427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-bf34a237-363d-4e9c-9b20-970bfeb2aba1 req-15597f7a-3dd8-453c-8cce-cda4df51bf10 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:28.228240 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-bf34a237-363d-4e9c-9b20-970bfeb2aba1 req-15597f7a-3dd8-453c-8cce-cda4df51bf10 service nova] Creating event network-changed:2c8b9b30-30ba-41ff-ac60-05b114ba25ae for instance 2e97b6da-f518-4292-9d9e-b99d27678b64 on hv-cinder-84902 Jul 11 20:59:28.233033 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-bf34a237-363d-4e9c-9b20-970bfeb2aba1 req-15597f7a-3dd8-453c-8cce-cda4df51bf10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031540 Jul 11 20:59:28.233616 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 154/311] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:59:28.380136 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-097083d7-3dba-4bae-8f87-906ead43b1f8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:28.380781 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-097083d7-3dba-4bae-8f87-906ead43b1f8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:28.387339 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-097083d7-3dba-4bae-8f87-906ead43b1f8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:28.387793 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-097083d7-3dba-4bae-8f87-906ead43b1f8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:28.388589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-097083d7-3dba-4bae-8f87-906ead43b1f8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:28.389049 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-097083d7-3dba-4bae-8f87-906ead43b1f8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:28.534333 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-097083d7-3dba-4bae-8f87-906ead43b1f8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:28.538979 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:28.543731 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-097083d7-3dba-4bae-8f87-906ead43b1f8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.169405 Jul 11 20:59:28.544383 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 158/312] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:28 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:29.089947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6ec4fc7c-378a-42a2-83f1-4dc0fd5e1ff2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:29.091298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6ec4fc7c-378a-42a2-83f1-4dc0fd5e1ff2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:29.099194 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6ec4fc7c-378a-42a2-83f1-4dc0fd5e1ff2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:29.099809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6ec4fc7c-378a-42a2-83f1-4dc0fd5e1ff2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:29.100617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6ec4fc7c-378a-42a2-83f1-4dc0fd5e1ff2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:29.101048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6ec4fc7c-378a-42a2-83f1-4dc0fd5e1ff2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:29.239343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6ec4fc7c-378a-42a2-83f1-4dc0fd5e1ff2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:29.247328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6ec4fc7c-378a-42a2-83f1-4dc0fd5e1ff2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.162215 Jul 11 20:59:29.247889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 155/313] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:29 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:29.562362 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-43b57a81-b4f1-4b9d-9e71-799e7a195719 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:29.563007 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-43b57a81-b4f1-4b9d-9e71-799e7a195719 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:29.570135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43b57a81-b4f1-4b9d-9e71-799e7a195719 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:29.570576 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43b57a81-b4f1-4b9d-9e71-799e7a195719 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:29.571330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43b57a81-b4f1-4b9d-9e71-799e7a195719 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:29.571756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43b57a81-b4f1-4b9d-9e71-799e7a195719 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:29.775983 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-43b57a81-b4f1-4b9d-9e71-799e7a195719 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:29.784774 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-43b57a81-b4f1-4b9d-9e71-799e7a195719 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.226326 Jul 11 20:59:29.785362 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 159/314] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:29 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:30.264209 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-dbc9231c-d8e4-4d8b-a9c5-5872f2efabb1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:30.265463 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-dbc9231c-d8e4-4d8b-a9c5-5872f2efabb1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:30.272275 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dbc9231c-d8e4-4d8b-a9c5-5872f2efabb1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:30.272722 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dbc9231c-d8e4-4d8b-a9c5-5872f2efabb1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:30.273494 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dbc9231c-d8e4-4d8b-a9c5-5872f2efabb1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:30.273906 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dbc9231c-d8e4-4d8b-a9c5-5872f2efabb1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:30.443225 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-dbc9231c-d8e4-4d8b-a9c5-5872f2efabb1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:30.452850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-dbc9231c-d8e4-4d8b-a9c5-5872f2efabb1 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.192666 Jul 11 20:59:30.453603 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 156/315] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:30 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:30.802097 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-72d89990-af58-4c36-bcb5-28713a12ce35 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:30.802789 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-72d89990-af58-4c36-bcb5-28713a12ce35 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:30.809469 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-72d89990-af58-4c36-bcb5-28713a12ce35 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:30.809938 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-72d89990-af58-4c36-bcb5-28713a12ce35 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:30.810697 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-72d89990-af58-4c36-bcb5-28713a12ce35 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:30.811131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-72d89990-af58-4c36-bcb5-28713a12ce35 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:30.952245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-72d89990-af58-4c36-bcb5-28713a12ce35 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:30.961967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-72d89990-af58-4c36-bcb5-28713a12ce35 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.163837 Jul 11 20:59:30.962671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 160/316] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:30 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:31.477132 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e29cd6e5-aea6-4a77-8e61-6386e0998450 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:31.478294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e29cd6e5-aea6-4a77-8e61-6386e0998450 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:31.484762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e29cd6e5-aea6-4a77-8e61-6386e0998450 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:31.485208 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e29cd6e5-aea6-4a77-8e61-6386e0998450 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:31.485970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e29cd6e5-aea6-4a77-8e61-6386e0998450 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:31.486395 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e29cd6e5-aea6-4a77-8e61-6386e0998450 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:31.715707 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e29cd6e5-aea6-4a77-8e61-6386e0998450 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:31.723560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e29cd6e5-aea6-4a77-8e61-6386e0998450 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.254996 Jul 11 20:59:31.725082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 157/317] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:31 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:31.980472 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9bfb5d11-b214-4db5-9a1e-2bfbc9b30580 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:31.981777 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9bfb5d11-b214-4db5-9a1e-2bfbc9b30580 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:31.989403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9bfb5d11-b214-4db5-9a1e-2bfbc9b30580 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:31.989936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9bfb5d11-b214-4db5-9a1e-2bfbc9b30580 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:31.990743 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9bfb5d11-b214-4db5-9a1e-2bfbc9b30580 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:31.991211 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9bfb5d11-b214-4db5-9a1e-2bfbc9b30580 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:32.266237 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9bfb5d11-b214-4db5-9a1e-2bfbc9b30580 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:32.274393 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9bfb5d11-b214-4db5-9a1e-2bfbc9b30580 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.297781 Jul 11 20:59:32.275246 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 161/318] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:31 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:32.744215 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e62b5671-95e7-4d8c-9daa-d3a68baeaf6d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:32.745343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e62b5671-95e7-4d8c-9daa-d3a68baeaf6d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:32.756635 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e62b5671-95e7-4d8c-9daa-d3a68baeaf6d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:32.757086 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e62b5671-95e7-4d8c-9daa-d3a68baeaf6d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:32.758277 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e62b5671-95e7-4d8c-9daa-d3a68baeaf6d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:32.758965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e62b5671-95e7-4d8c-9daa-d3a68baeaf6d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:32.900478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e62b5671-95e7-4d8c-9daa-d3a68baeaf6d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:32.908234 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e62b5671-95e7-4d8c-9daa-d3a68baeaf6d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.169277 Jul 11 20:59:32.908801 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 158/319] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:32 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:33.291982 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ebaa880b-9520-4bb8-b9d9-34778473d5f7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:33.292733 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ebaa880b-9520-4bb8-b9d9-34778473d5f7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:33.298948 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ebaa880b-9520-4bb8-b9d9-34778473d5f7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.299406 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ebaa880b-9520-4bb8-b9d9-34778473d5f7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:33.300202 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ebaa880b-9520-4bb8-b9d9-34778473d5f7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.300667 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ebaa880b-9520-4bb8-b9d9-34778473d5f7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:33.446859 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ebaa880b-9520-4bb8-b9d9-34778473d5f7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:33.458432 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ebaa880b-9520-4bb8-b9d9-34778473d5f7 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1500 microversion: 2.1 time: 0.170870 Jul 11 20:59:33.459199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 162/320] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:33 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1500 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:33.475928 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76073451-4bbb-454a-888c-563152f3ed89"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:33.477710 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:33.486104 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.486698 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:33.487846 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.488407 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:33.493436 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:33.514640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] HTTP exception thrown: Cannot 'attach_volume' instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 while it is in vm_state rescued Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Request method failure captured: Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: POST /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591/os-volume_attachments HTTP/1.1 Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 74 Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI62lRWdgL26NSoKvMm26ZR-MIh8lmsoilICwbHhZnefhyhzZZn4QE3yYGVFYUEf6Gb7DhWQjbnLqk-TfBxwd3HjP10g6J39OOhDcjatM8tyLGCx3fY8gZ1ahcVk4eSU13TT33VA4MEvj266VSZq1shx9AlAMKROF46H5Fp0GmVFal4 Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 20:59:33.516382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6f21a94f61e42c9b967e673f02eb270", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: aa7e6c5842a84e91ac94c1107ad29158 Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {"volumeAttachment": {"volumeId": "76073451-4bbb-454a-888c-563152f3ed89"}} Jul 11 20:59:33.517711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Cannot 'attach_volume' instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 while it is in vm_state rescued Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'server_id': 'd5b0e455-1e94-4e5c-b6c1-9a03cfcc3591', 'body': {'volumeAttachment': {'volumeId': '76073451-4bbb-454a-888c-563152f3ed89'}}} Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:59:33.518447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 while it is in vm_state rescued Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:33.519720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:33.520975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:59:33.520975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:59:33.520975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 while it is in vm_state rescued Jul 11 20:59:33.520975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 20:59:33.520975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Returning 409 to user: Cannot 'attach_volume' instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 while it is in vm_state rescued {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:59:33.520975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b30f2080-5535-4faa-8c37-6bc920d56215 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046021 Jul 11 20:59:33.520975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 159/321] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 20:59:33 2022] POST /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 11 20:59:33.527420 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-bcae36dd-2c88-44d5-bf6f-34585efdd427 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:33.527953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-bcae36dd-2c88-44d5-bf6f-34585efdd427 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:33.534446 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bcae36dd-2c88-44d5-bf6f-34585efdd427 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.534898 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bcae36dd-2c88-44d5-bf6f-34585efdd427 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:33.535661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bcae36dd-2c88-44d5-bf6f-34585efdd427 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.536094 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bcae36dd-2c88-44d5-bf6f-34585efdd427 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:33.609126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-bcae36dd-2c88-44d5-bf6f-34585efdd427 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591/action" status: 202 len: 0 microversion: 2.1 time: 0.085388 Jul 11 20:59:33.610382 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 163/322] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 20:59:33 2022] POST /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 20:59:33.619348 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4288bebc-8a9b-48f3-9f99-df4d835fd1c5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:33.619956 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4288bebc-8a9b-48f3-9f99-df4d835fd1c5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:33.626420 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4288bebc-8a9b-48f3-9f99-df4d835fd1c5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.626868 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4288bebc-8a9b-48f3-9f99-df4d835fd1c5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:33.627624 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4288bebc-8a9b-48f3-9f99-df4d835fd1c5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.628060 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4288bebc-8a9b-48f3-9f99-df4d835fd1c5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:33.781935 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4288bebc-8a9b-48f3-9f99-df4d835fd1c5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:33.789638 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4288bebc-8a9b-48f3-9f99-df4d835fd1c5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1508 microversion: 2.1 time: 0.174864 Jul 11 20:59:33.790201 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 160/323] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:33 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:33.926903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-13438f08-fd30-468e-bee3-1a1e48ca4e7b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:33.927872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-13438f08-fd30-468e-bee3-1a1e48ca4e7b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:33.936293 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13438f08-fd30-468e-bee3-1a1e48ca4e7b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.936748 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13438f08-fd30-468e-bee3-1a1e48ca4e7b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:33.937520 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13438f08-fd30-468e-bee3-1a1e48ca4e7b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:33.937950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13438f08-fd30-468e-bee3-1a1e48ca4e7b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:34.094579 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-13438f08-fd30-468e-bee3-1a1e48ca4e7b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:34.102856 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-13438f08-fd30-468e-bee3-1a1e48ca4e7b tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.180648 Jul 11 20:59:34.103426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 164/324] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:33 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:34.726009 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-381060466", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "networks": [{"uuid": "9f72b8bb-74fb-4b92-94e7-3d4997851570"}]}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:34.794687 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] validate_networks() for [('9f72b8bb-74fb-4b92-94e7-3d4997851570', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 20:59:34.807932 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f48dff54-3dea-48e3-93ba-9638088733ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:34.808756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f48dff54-3dea-48e3-93ba-9638088733ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:34.816489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f48dff54-3dea-48e3-93ba-9638088733ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:34.816916 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f48dff54-3dea-48e3-93ba-9638088733ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:34.817723 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f48dff54-3dea-48e3-93ba-9638088733ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:34.818155 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f48dff54-3dea-48e3-93ba-9638088733ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:34.958117 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f48dff54-3dea-48e3-93ba-9638088733ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:34.968198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f48dff54-3dea-48e3-93ba-9638088733ec tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1508 microversion: 2.1 time: 0.164845 Jul 11 20:59:34.968787 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 165/325] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:34 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:35.124473 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2c92692d-6dde-40b5-9eee-90331165840f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:35.125092 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2c92692d-6dde-40b5-9eee-90331165840f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:35.131458 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2c92692d-6dde-40b5-9eee-90331165840f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:35.131936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2c92692d-6dde-40b5-9eee-90331165840f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:35.132736 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2c92692d-6dde-40b5-9eee-90331165840f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:35.133169 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2c92692d-6dde-40b5-9eee-90331165840f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:35.172856 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 20:59:35.173266 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 20:59:35.173761 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 20:59:35.174156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 20:59:35.174550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 20:59:35.184612 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:35.185046 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:35.186085 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:35.186600 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:35.203919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Getting quotas for project 36d40e24cac74460bbbed4dffce9a4da. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:59:35.208641 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Getting quotas for user 63ec8ab7842a443c922a39f5ffcfd51a and project 36d40e24cac74460bbbed4dffce9a4da. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:59:35.220499 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 20:59:35.222756 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 20:59:35.265621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2c92692d-6dde-40b5-9eee-90331165840f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:35.270209 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9ee572f1-4260-4b97-92d5-ab3f82a785d2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548310 Jul 11 20:59:35.276623 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 161/326] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 20:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 20:59:35.279584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2c92692d-6dde-40b5-9eee-90331165840f tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.159912 Jul 11 20:59:35.280317 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 166/327] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:35 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:35.281910 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a27dba1c-762c-45ce-8330-3efe78a094b6 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:35.282509 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a27dba1c-762c-45ce-8330-3efe78a094b6 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:35.337335 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a27dba1c-762c-45ce-8330-3efe78a094b6 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:35.345028 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a27dba1c-762c-45ce-8330-3efe78a094b6 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1218 microversion: 2.1 time: 0.067299 Jul 11 20:59:35.345583 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 162/328] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:35 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:35.986092 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2555b04e-917d-4a5c-840f-4fcb0b46bc6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:35.987306 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2555b04e-917d-4a5c-840f-4fcb0b46bc6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:35.989598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:35.995693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2555b04e-917d-4a5c-840f-4fcb0b46bc6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:35.996504 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2555b04e-917d-4a5c-840f-4fcb0b46bc6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:35.997315 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2555b04e-917d-4a5c-840f-4fcb0b46bc6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:35.997793 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2555b04e-917d-4a5c-840f-4fcb0b46bc6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:36.136359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2555b04e-917d-4a5c-840f-4fcb0b46bc6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:36.146959 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2555b04e-917d-4a5c-840f-4fcb0b46bc6d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1508 microversion: 2.1 time: 0.165106 Jul 11 20:59:36.147850 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 167/329] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:35 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:36.297133 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c774a97b-73de-4a84-b039-d68108ea8141 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:36.297692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c774a97b-73de-4a84-b039-d68108ea8141 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:36.304537 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c774a97b-73de-4a84-b039-d68108ea8141 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:36.304984 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c774a97b-73de-4a84-b039-d68108ea8141 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:36.306141 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c774a97b-73de-4a84-b039-d68108ea8141 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:36.306571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c774a97b-73de-4a84-b039-d68108ea8141 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:36.362656 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-79a1f64c-6bc3-4f2f-b7f8-772a64fbabb7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:36.363287 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-79a1f64c-6bc3-4f2f-b7f8-772a64fbabb7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:36.373582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-79a1f64c-6bc3-4f2f-b7f8-772a64fbabb7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:36.374172 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-79a1f64c-6bc3-4f2f-b7f8-772a64fbabb7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:36.375122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-79a1f64c-6bc3-4f2f-b7f8-772a64fbabb7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:36.375791 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-79a1f64c-6bc3-4f2f-b7f8-772a64fbabb7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:36.456428 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-79a1f64c-6bc3-4f2f-b7f8-772a64fbabb7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:36.466763 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-79a1f64c-6bc3-4f2f-b7f8-772a64fbabb7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1270 microversion: 2.1 time: 0.107961 Jul 11 20:59:36.468225 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 168/330] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:36 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:36.488517 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c774a97b-73de-4a84-b039-d68108ea8141 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:36.501053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c774a97b-73de-4a84-b039-d68108ea8141 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.206849 Jul 11 20:59:36.512100 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 163/331] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:36 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:37.167401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3b3d8267-a5e3-420f-a2bb-a8f9f7ebb84a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:37.168629 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3b3d8267-a5e3-420f-a2bb-a8f9f7ebb84a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:37.175345 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b3d8267-a5e3-420f-a2bb-a8f9f7ebb84a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:37.176096 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b3d8267-a5e3-420f-a2bb-a8f9f7ebb84a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:37.176965 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b3d8267-a5e3-420f-a2bb-a8f9f7ebb84a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:37.177283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b3d8267-a5e3-420f-a2bb-a8f9f7ebb84a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:37.379361 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3b3d8267-a5e3-420f-a2bb-a8f9f7ebb84a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:37.387260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3b3d8267-a5e3-420f-a2bb-a8f9f7ebb84a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1508 microversion: 2.1 time: 0.223988 Jul 11 20:59:37.387837 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 169/332] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:37 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:37.484826 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bf4fd7c7-5b67-4fdd-a9de-8e497e0c6e3e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:37.485412 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bf4fd7c7-5b67-4fdd-a9de-8e497e0c6e3e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:37.492338 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bf4fd7c7-5b67-4fdd-a9de-8e497e0c6e3e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:37.492752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bf4fd7c7-5b67-4fdd-a9de-8e497e0c6e3e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:37.493710 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bf4fd7c7-5b67-4fdd-a9de-8e497e0c6e3e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:37.494166 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bf4fd7c7-5b67-4fdd-a9de-8e497e0c6e3e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:37.519696 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f9c38859-da05-413c-b351-7b7e63997f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:37.520577 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f9c38859-da05-413c-b351-7b7e63997f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:37.531988 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f9c38859-da05-413c-b351-7b7e63997f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:37.537385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f9c38859-da05-413c-b351-7b7e63997f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:37.538086 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f9c38859-da05-413c-b351-7b7e63997f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:37.538673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f9c38859-da05-413c-b351-7b7e63997f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:37.700653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f9c38859-da05-413c-b351-7b7e63997f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:37.709026 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f9c38859-da05-413c-b351-7b7e63997f14 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.194123 Jul 11 20:59:37.709602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 170/333] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:37 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:37.785508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bf4fd7c7-5b67-4fdd-a9de-8e497e0c6e3e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:37.793484 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bf4fd7c7-5b67-4fdd-a9de-8e497e0c6e3e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.312673 Jul 11 20:59:37.794090 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 164/334] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:37 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:37.997506 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-97c961f3-a2d4-4be3-a85f-ab851e280232 req-146ae66e-e474-4f62-836a-fb9d2484a4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c351b1b3-411c-4042-b8a7-a8370a2f161c", "tag": "f16e4c4e-a386-47de-93b8-b66a6d98055c"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:38.005959 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-97c961f3-a2d4-4be3-a85f-ab851e280232 req-146ae66e-e474-4f62-836a-fb9d2484a4c8 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:38.006428 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-97c961f3-a2d4-4be3-a85f-ab851e280232 req-146ae66e-e474-4f62-836a-fb9d2484a4c8 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:38.017987 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-97c961f3-a2d4-4be3-a85f-ab851e280232 req-146ae66e-e474-4f62-836a-fb9d2484a4c8 service nova] Creating event network-changed:f16e4c4e-a386-47de-93b8-b66a6d98055c for instance c351b1b3-411c-4042-b8a7-a8370a2f161c on hv-cinder-84902 Jul 11 20:59:38.022769 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-97c961f3-a2d4-4be3-a85f-ab851e280232 req-146ae66e-e474-4f62-836a-fb9d2484a4c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029037 Jul 11 20:59:38.023361 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 171/335] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:59:38.408249 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-105d4c0b-16b3-49ae-9826-9caf09439338 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:38.409238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-105d4c0b-16b3-49ae-9826-9caf09439338 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:38.419859 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-105d4c0b-16b3-49ae-9826-9caf09439338 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:38.420656 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-105d4c0b-16b3-49ae-9826-9caf09439338 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:38.421870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-105d4c0b-16b3-49ae-9826-9caf09439338 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:38.422590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-105d4c0b-16b3-49ae-9826-9caf09439338 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:38.561208 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-105d4c0b-16b3-49ae-9826-9caf09439338 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:38.570913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-105d4c0b-16b3-49ae-9826-9caf09439338 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1508 microversion: 2.1 time: 0.169387 Jul 11 20:59:38.571478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 165/336] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:38 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:38.730749 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9bed92b3-d3fd-4f22-973a-e3bdaca0c6ec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:38.731422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9bed92b3-d3fd-4f22-973a-e3bdaca0c6ec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:38.738706 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9bed92b3-d3fd-4f22-973a-e3bdaca0c6ec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:38.739194 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9bed92b3-d3fd-4f22-973a-e3bdaca0c6ec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:38.740029 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9bed92b3-d3fd-4f22-973a-e3bdaca0c6ec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:38.740552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9bed92b3-d3fd-4f22-973a-e3bdaca0c6ec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:38.811343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9016fd06-2048-4275-b26c-fdd38c915cd7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:38.811951 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9016fd06-2048-4275-b26c-fdd38c915cd7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:38.820331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9016fd06-2048-4275-b26c-fdd38c915cd7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:38.821059 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9016fd06-2048-4275-b26c-fdd38c915cd7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:38.821834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9016fd06-2048-4275-b26c-fdd38c915cd7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:38.822237 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9016fd06-2048-4275-b26c-fdd38c915cd7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:38.886966 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9bed92b3-d3fd-4f22-973a-e3bdaca0c6ec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:38.894499 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9bed92b3-d3fd-4f22-973a-e3bdaca0c6ec tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.170471 Jul 11 20:59:38.895070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 172/337] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:38 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:38.961818 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9016fd06-2048-4275-b26c-fdd38c915cd7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:38.974602 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9016fd06-2048-4275-b26c-fdd38c915cd7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.167080 Jul 11 20:59:38.975371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 166/338] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:38 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:39.192059 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-b215d939-c7b8-4ab2-8481-15c0200328af req-f937aede-03b4-4ee4-acc7-bc6252ec9e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e97b6da-f518-4292-9d9e-b99d27678b64", "name": "network-vif-plugged", "status": "completed", "tag": "2c8b9b30-30ba-41ff-ac60-05b114ba25ae"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:39.200541 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b215d939-c7b8-4ab2-8481-15c0200328af req-f937aede-03b4-4ee4-acc7-bc6252ec9e8c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:39.201059 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b215d939-c7b8-4ab2-8481-15c0200328af req-f937aede-03b4-4ee4-acc7-bc6252ec9e8c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:39.212481 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-b215d939-c7b8-4ab2-8481-15c0200328af req-f937aede-03b4-4ee4-acc7-bc6252ec9e8c service nova] Creating event network-vif-plugged:2c8b9b30-30ba-41ff-ac60-05b114ba25ae for instance 2e97b6da-f518-4292-9d9e-b99d27678b64 on hv-cinder-84902 Jul 11 20:59:39.217999 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-b215d939-c7b8-4ab2-8481-15c0200328af req-f937aede-03b4-4ee4-acc7-bc6252ec9e8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029860 Jul 11 20:59:39.218581 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 173/339] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:59:39.592297 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-749cfe36-d543-4491-b8fe-d1a328477114 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:39.593296 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-749cfe36-d543-4491-b8fe-d1a328477114 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:39.604621 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-749cfe36-d543-4491-b8fe-d1a328477114 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:39.605065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-749cfe36-d543-4491-b8fe-d1a328477114 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:39.605831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-749cfe36-d543-4491-b8fe-d1a328477114 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:39.606320 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-749cfe36-d543-4491-b8fe-d1a328477114 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:39.736761 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-749cfe36-d543-4491-b8fe-d1a328477114 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:39.748582 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-749cfe36-d543-4491-b8fe-d1a328477114 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1508 microversion: 2.1 time: 0.162854 Jul 11 20:59:39.749397 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 167/340] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:39 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:39.913155 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-27092d0d-2ba9-47c8-a8bd-6c225354410e tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:39.913847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-27092d0d-2ba9-47c8-a8bd-6c225354410e tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:39.921860 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-27092d0d-2ba9-47c8-a8bd-6c225354410e tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:39.922310 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-27092d0d-2ba9-47c8-a8bd-6c225354410e tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:39.923076 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-27092d0d-2ba9-47c8-a8bd-6c225354410e tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:39.923509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-27092d0d-2ba9-47c8-a8bd-6c225354410e tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:39.994362 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ff8be4d2-c9e6-47a1-ab6d-a5e418664360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:39.995146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ff8be4d2-c9e6-47a1-ab6d-a5e418664360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:40.001513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ff8be4d2-c9e6-47a1-ab6d-a5e418664360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:40.001959 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ff8be4d2-c9e6-47a1-ab6d-a5e418664360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:40.002727 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ff8be4d2-c9e6-47a1-ab6d-a5e418664360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:40.003153 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ff8be4d2-c9e6-47a1-ab6d-a5e418664360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:40.082008 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-27092d0d-2ba9-47c8-a8bd-6c225354410e tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:40.091416 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-27092d0d-2ba9-47c8-a8bd-6c225354410e tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.182573 Jul 11 20:59:40.094119 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 174/341] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:39 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:40.343421 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ff8be4d2-c9e6-47a1-ab6d-a5e418664360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:40.352924 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ff8be4d2-c9e6-47a1-ab6d-a5e418664360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.362513 Jul 11 20:59:40.357875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 168/342] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:39 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:40.768552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7e003aa9-9eaa-4625-a8e0-53714a8b4fee tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:40.769165 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7e003aa9-9eaa-4625-a8e0-53714a8b4fee tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:40.775323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7e003aa9-9eaa-4625-a8e0-53714a8b4fee tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:40.775890 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7e003aa9-9eaa-4625-a8e0-53714a8b4fee tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:40.777002 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7e003aa9-9eaa-4625-a8e0-53714a8b4fee tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:40.777460 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7e003aa9-9eaa-4625-a8e0-53714a8b4fee tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:40.947165 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7e003aa9-9eaa-4625-a8e0-53714a8b4fee tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:40.950943 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:40.956121 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7e003aa9-9eaa-4625-a8e0-53714a8b4fee tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1514 microversion: 2.1 time: 0.191697 Jul 11 20:59:40.957041 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 175/343] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:40 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:41.111572 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ab923464-9abd-4e11-b53c-edcbc72c5bfb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:41.112839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ab923464-9abd-4e11-b53c-edcbc72c5bfb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:41.121223 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ab923464-9abd-4e11-b53c-edcbc72c5bfb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:41.121759 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ab923464-9abd-4e11-b53c-edcbc72c5bfb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:41.122772 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ab923464-9abd-4e11-b53c-edcbc72c5bfb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:41.123206 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ab923464-9abd-4e11-b53c-edcbc72c5bfb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:41.278997 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ab923464-9abd-4e11-b53c-edcbc72c5bfb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:41.286370 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ab923464-9abd-4e11-b53c-edcbc72c5bfb tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.179906 Jul 11 20:59:41.286945 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 169/344] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:41 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:41.375372 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-db8298cb-b143-444f-95af-da0b0c329c47 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:41.376033 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-db8298cb-b143-444f-95af-da0b0c329c47 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:41.382749 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-db8298cb-b143-444f-95af-da0b0c329c47 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:41.383189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-db8298cb-b143-444f-95af-da0b0c329c47 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:41.383936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-db8298cb-b143-444f-95af-da0b0c329c47 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:41.384387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-db8298cb-b143-444f-95af-da0b0c329c47 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:41.522789 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-db8298cb-b143-444f-95af-da0b0c329c47 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:41.531848 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-db8298cb-b143-444f-95af-da0b0c329c47 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.160956 Jul 11 20:59:41.532431 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 176/345] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:41 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:42.307701 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-782263a2-0833-4376-84e1-7d6a07f3f707 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:42.308493 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-782263a2-0833-4376-84e1-7d6a07f3f707 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:42.315406 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-782263a2-0833-4376-84e1-7d6a07f3f707 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:42.315852 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-782263a2-0833-4376-84e1-7d6a07f3f707 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:42.316654 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-782263a2-0833-4376-84e1-7d6a07f3f707 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:42.317088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-782263a2-0833-4376-84e1-7d6a07f3f707 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:42.448022 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-782263a2-0833-4376-84e1-7d6a07f3f707 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:42.459119 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-782263a2-0833-4376-84e1-7d6a07f3f707 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.158154 Jul 11 20:59:42.459624 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 170/346] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:42 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:42.549079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1882e864-0510-4a92-897a-9d22ecae1483 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:42.549649 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1882e864-0510-4a92-897a-9d22ecae1483 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:42.556465 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1882e864-0510-4a92-897a-9d22ecae1483 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:42.556887 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1882e864-0510-4a92-897a-9d22ecae1483 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:42.557644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1882e864-0510-4a92-897a-9d22ecae1483 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:42.558100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1882e864-0510-4a92-897a-9d22ecae1483 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:42.702182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1882e864-0510-4a92-897a-9d22ecae1483 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:42.710219 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1882e864-0510-4a92-897a-9d22ecae1483 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.165024 Jul 11 20:59:42.710715 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 177/347] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:42 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:43.404993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0f228f53-4e21-4cef-bfb1-128919e20201 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'create', calling method: .version_select at 0x7f3840534280>, body: {"keypair": {"name": "tempest-keypair-1944537304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXoQIl/shB+Yhm9Wzl7Ny9TdgL+mOx3RK2eC3cEX4n0aw7YTx7/o5CGW+Ls9vzw6hLRXfduY8//RPnNujrsoi9RADh7rusE856oCn3VtFOwasoATtNlOrf32TNMmmAYhg=="}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:43.425238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-0f228f53-4e21-4cef-bfb1-128919e20201 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Getting quotas for project c6f21a94f61e42c9b967e673f02eb270. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:59:43.429627 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-0f228f53-4e21-4cef-bfb1-128919e20201 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Getting quotas for user aa7e6c5842a84e91ac94c1107ad29158 and project c6f21a94f61e42c9b967e673f02eb270. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:59:43.468186 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0f228f53-4e21-4cef-bfb1-128919e20201 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067151 Jul 11 20:59:43.468787 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 171/348] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 20:59:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:59:43.476640 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b2b48632-022d-4276-9cdf-db58be4867f2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:43.477274 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b2b48632-022d-4276-9cdf-db58be4867f2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:43.483598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b2b48632-022d-4276-9cdf-db58be4867f2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:43.484039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b2b48632-022d-4276-9cdf-db58be4867f2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:43.484826 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b2b48632-022d-4276-9cdf-db58be4867f2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:43.485233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b2b48632-022d-4276-9cdf-db58be4867f2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:43.677429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b2b48632-022d-4276-9cdf-db58be4867f2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:43.686469 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b2b48632-022d-4276-9cdf-db58be4867f2 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1314 microversion: 2.1 time: 0.213588 Jul 11 20:59:43.687136 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 178/349] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:43 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:43.732301 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8c9c33a2-8e15-4dcf-b659-11974449cd43 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:43.732909 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8c9c33a2-8e15-4dcf-b659-11974449cd43 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:43.739310 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8c9c33a2-8e15-4dcf-b659-11974449cd43 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:43.739760 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8c9c33a2-8e15-4dcf-b659-11974449cd43 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:43.740557 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8c9c33a2-8e15-4dcf-b659-11974449cd43 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:43.741031 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8c9c33a2-8e15-4dcf-b659-11974449cd43 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:43.901518 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8c9c33a2-8e15-4dcf-b659-11974449cd43 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:43.910322 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8c9c33a2-8e15-4dcf-b659-11974449cd43 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.182212 Jul 11 20:59:43.919561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 172/350] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:43 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:44.703304 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d82ad074-25ef-42e2-993d-f067c0fd6c04 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:44.703907 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d82ad074-25ef-42e2-993d-f067c0fd6c04 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:44.710316 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d82ad074-25ef-42e2-993d-f067c0fd6c04 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:44.710773 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d82ad074-25ef-42e2-993d-f067c0fd6c04 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:44.711574 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d82ad074-25ef-42e2-993d-f067c0fd6c04 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:44.712007 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d82ad074-25ef-42e2-993d-f067c0fd6c04 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:44.842961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2055597783", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b08ea06-c0b9-4a12-86e3-86d9bf3cae78"}], "security_groups": [{"name": "tempest-securitygroup--1855775777"}], "key_name": "tempest-keypair-1944537304", "user_data": "}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:44.850220 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:44.857639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d82ad074-25ef-42e2-993d-f067c0fd6c04 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:44.865539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d82ad074-25ef-42e2-993d-f067c0fd6c04 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1497 microversion: 2.1 time: 0.166525 Jul 11 20:59:44.866110 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 179/351] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:44 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:44.927063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-98d1ffc6-19da-4ca2-a786-261f2dcb394d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:44.927671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-98d1ffc6-19da-4ca2-a786-261f2dcb394d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:44.935197 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-98d1ffc6-19da-4ca2-a786-261f2dcb394d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:44.935646 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-98d1ffc6-19da-4ca2-a786-261f2dcb394d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:44.937190 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-98d1ffc6-19da-4ca2-a786-261f2dcb394d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:44.937758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-98d1ffc6-19da-4ca2-a786-261f2dcb394d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:44.955808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] validate_networks() for [('6b08ea06-c0b9-4a12-86e3-86d9bf3cae78', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 20:59:45.071313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-98d1ffc6-19da-4ca2-a786-261f2dcb394d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:45.079248 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-98d1ffc6-19da-4ca2-a786-261f2dcb394d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.156057 Jul 11 20:59:45.080040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 180/352] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:44 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:45.192894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=4 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:45.351236 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 20:59:45.351655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 20:59:45.352130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 20:59:45.352607 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 20:59:45.353033 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 20:59:45.362033 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:45.362492 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:45.363299 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:45.363740 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:45.384717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Getting quotas for project c6f21a94f61e42c9b967e673f02eb270. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 20:59:45.389688 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Getting quotas for user aa7e6c5842a84e91ac94c1107ad29158 and project c6f21a94f61e42c9b967e673f02eb270. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 20:59:45.401841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 20:59:45.403997 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 20:59:45.429562 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f07194bc-965e-4d93-8e21-f8b3a8124d10 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:45.430505 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f07194bc-965e-4d93-8e21-f8b3a8124d10 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:45.437543 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f07194bc-965e-4d93-8e21-f8b3a8124d10 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:45.438089 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f07194bc-965e-4d93-8e21-f8b3a8124d10 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:45.438880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f07194bc-965e-4d93-8e21-f8b3a8124d10 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:45.439325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f07194bc-965e-4d93-8e21-f8b3a8124d10 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:45.452760 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5898a6c5-ab5e-4f9d-870a-2ece4421a999 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.614334 Jul 11 20:59:45.453617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 173/353] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 20:59:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 20:59:45.463647 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d99ce965-62f5-40c8-ab55-ce10ec4e6fdb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:45.465058 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d99ce965-62f5-40c8-ab55-ce10ec4e6fdb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:45.466236 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f07194bc-965e-4d93-8e21-f8b3a8124d10 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 20:59:45.535836 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d99ce965-62f5-40c8-ab55-ce10ec4e6fdb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:45.543563 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d99ce965-62f5-40c8-ab55-ce10ec4e6fdb tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1246 microversion: 2.1 time: 0.083888 Jul 11 20:59:45.544481 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 174/354] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:45 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:45.579735 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f07194bc-965e-4d93-8e21-f8b3a8124d10 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 204 len: 0 microversion: 2.1 time: 0.153910 Jul 11 20:59:45.580590 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 181/355] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 20:59:45 2022] DELETE /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 20:59:45.592161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7366fd90-1344-48e7-a26d-392a931262b3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:45.592322 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7366fd90-1344-48e7-a26d-392a931262b3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:45.601672 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7366fd90-1344-48e7-a26d-392a931262b3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:45.602192 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7366fd90-1344-48e7-a26d-392a931262b3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:45.603201 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7366fd90-1344-48e7-a26d-392a931262b3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:45.603863 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7366fd90-1344-48e7-a26d-392a931262b3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:45.745154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7366fd90-1344-48e7-a26d-392a931262b3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:45.754363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7366fd90-1344-48e7-a26d-392a931262b3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1503 microversion: 2.1 time: 0.169256 Jul 11 20:59:45.754957 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 175/356] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:45 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:46.101248 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-53e3a9f6-f61e-4581-a195-2af06dac9db2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:46.102281 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-53e3a9f6-f61e-4581-a195-2af06dac9db2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:46.113027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53e3a9f6-f61e-4581-a195-2af06dac9db2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:46.113769 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53e3a9f6-f61e-4581-a195-2af06dac9db2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:46.115012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53e3a9f6-f61e-4581-a195-2af06dac9db2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:46.115728 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53e3a9f6-f61e-4581-a195-2af06dac9db2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:46.247836 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-53e3a9f6-f61e-4581-a195-2af06dac9db2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:46.255446 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-53e3a9f6-f61e-4581-a195-2af06dac9db2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.161476 Jul 11 20:59:46.255992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 182/357] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:46 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:46.565631 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cce9a61d-931d-4cb8-8ee7-b031122da021 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:46.566601 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cce9a61d-931d-4cb8-8ee7-b031122da021 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:46.578067 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cce9a61d-931d-4cb8-8ee7-b031122da021 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:46.578798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cce9a61d-931d-4cb8-8ee7-b031122da021 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:46.580065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cce9a61d-931d-4cb8-8ee7-b031122da021 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:46.580830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cce9a61d-931d-4cb8-8ee7-b031122da021 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:46.648602 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cce9a61d-931d-4cb8-8ee7-b031122da021 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:46.656406 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cce9a61d-931d-4cb8-8ee7-b031122da021 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1250 microversion: 2.1 time: 0.097389 Jul 11 20:59:46.656984 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 176/358] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:46 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:46.775908 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2d8204e9-c901-4181-a8d2-22376e91c18c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:46.776688 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2d8204e9-c901-4181-a8d2-22376e91c18c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:46.783179 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2d8204e9-c901-4181-a8d2-22376e91c18c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:46.783623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2d8204e9-c901-4181-a8d2-22376e91c18c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:46.784407 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2d8204e9-c901-4181-a8d2-22376e91c18c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:46.784842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2d8204e9-c901-4181-a8d2-22376e91c18c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:46.915180 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2d8204e9-c901-4181-a8d2-22376e91c18c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:46.926551 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2d8204e9-c901-4181-a8d2-22376e91c18c tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1503 microversion: 2.1 time: 0.157012 Jul 11 20:59:46.927201 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 183/359] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:46 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:47.277083 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9c73554a-7905-428f-8040-25bdf9762372 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:47.278121 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9c73554a-7905-428f-8040-25bdf9762372 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:47.288548 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9c73554a-7905-428f-8040-25bdf9762372 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:47.289284 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9c73554a-7905-428f-8040-25bdf9762372 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:47.290527 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9c73554a-7905-428f-8040-25bdf9762372 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:47.291428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9c73554a-7905-428f-8040-25bdf9762372 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:47.424578 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9c73554a-7905-428f-8040-25bdf9762372 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:47.435433 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9c73554a-7905-428f-8040-25bdf9762372 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.164899 Jul 11 20:59:47.436000 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 177/360] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:47 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:47.673927 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-875ba043-0e2d-4885-9679-423c57a5c874 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:47.674547 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-875ba043-0e2d-4885-9679-423c57a5c874 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:47.681689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-875ba043-0e2d-4885-9679-423c57a5c874 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:47.682580 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-875ba043-0e2d-4885-9679-423c57a5c874 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:47.683362 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-875ba043-0e2d-4885-9679-423c57a5c874 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:47.683792 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-875ba043-0e2d-4885-9679-423c57a5c874 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:47.744567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-875ba043-0e2d-4885-9679-423c57a5c874 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:47.752265 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-875ba043-0e2d-4885-9679-423c57a5c874 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1250 microversion: 2.1 time: 0.082479 Jul 11 20:59:47.752823 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 184/361] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:47 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:47.946249 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cf783384-9457-4d5b-a697-e3f5ea8d5bf0 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:47.946778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cf783384-9457-4d5b-a697-e3f5ea8d5bf0 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:47.954230 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf783384-9457-4d5b-a697-e3f5ea8d5bf0 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:47.954687 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf783384-9457-4d5b-a697-e3f5ea8d5bf0 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:47.955747 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf783384-9457-4d5b-a697-e3f5ea8d5bf0 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:47.956282 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf783384-9457-4d5b-a697-e3f5ea8d5bf0 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:48.097809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cf783384-9457-4d5b-a697-e3f5ea8d5bf0 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:48.105979 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cf783384-9457-4d5b-a697-e3f5ea8d5bf0 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1503 microversion: 2.1 time: 0.164101 Jul 11 20:59:48.106548 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 178/362] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:47 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:48.452246 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ee6e5d8e-9ee3-497a-9f39-5b88e7f1496c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:48.452827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ee6e5d8e-9ee3-497a-9f39-5b88e7f1496c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:48.458959 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ee6e5d8e-9ee3-497a-9f39-5b88e7f1496c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:48.459404 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ee6e5d8e-9ee3-497a-9f39-5b88e7f1496c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:48.460178 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ee6e5d8e-9ee3-497a-9f39-5b88e7f1496c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:48.460605 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ee6e5d8e-9ee3-497a-9f39-5b88e7f1496c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:48.594107 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ee6e5d8e-9ee3-497a-9f39-5b88e7f1496c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:48.603556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ee6e5d8e-9ee3-497a-9f39-5b88e7f1496c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.154926 Jul 11 20:59:48.604905 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 185/363] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:48 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:48.769048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-648adb7d-36d4-4b8b-9266-4860b3e33537 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:48.769673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-648adb7d-36d4-4b8b-9266-4860b3e33537 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:48.776263 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-648adb7d-36d4-4b8b-9266-4860b3e33537 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:48.776788 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-648adb7d-36d4-4b8b-9266-4860b3e33537 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:48.777567 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-648adb7d-36d4-4b8b-9266-4860b3e33537 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:48.778144 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-648adb7d-36d4-4b8b-9266-4860b3e33537 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:48.850492 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-648adb7d-36d4-4b8b-9266-4860b3e33537 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:48.861915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-648adb7d-36d4-4b8b-9266-4860b3e33537 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1250 microversion: 2.1 time: 0.096880 Jul 11 20:59:48.862478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 179/364] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:48 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1250 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:49.123404 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-18bf0676-fc6e-4dfc-b160-6f529c9bac3d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:49.124020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-18bf0676-fc6e-4dfc-b160-6f529c9bac3d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:49.130625 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-18bf0676-fc6e-4dfc-b160-6f529c9bac3d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:49.131075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-18bf0676-fc6e-4dfc-b160-6f529c9bac3d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:49.131840 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-18bf0676-fc6e-4dfc-b160-6f529c9bac3d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:49.132584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-18bf0676-fc6e-4dfc-b160-6f529c9bac3d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:49.266486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-18bf0676-fc6e-4dfc-b160-6f529c9bac3d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:49.275215 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-18bf0676-fc6e-4dfc-b160-6f529c9bac3d tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1503 microversion: 2.1 time: 0.155969 Jul 11 20:59:49.276034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 186/365] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:49 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:49.621532 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f546a91e-c0f2-4ccc-ab31-23b51e6e5722 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:49.622133 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f546a91e-c0f2-4ccc-ab31-23b51e6e5722 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:49.628801 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f546a91e-c0f2-4ccc-ab31-23b51e6e5722 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:49.629243 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f546a91e-c0f2-4ccc-ab31-23b51e6e5722 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:49.630000 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f546a91e-c0f2-4ccc-ab31-23b51e6e5722 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:49.630425 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f546a91e-c0f2-4ccc-ab31-23b51e6e5722 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:49.650308 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:49.778422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f546a91e-c0f2-4ccc-ab31-23b51e6e5722 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:49.786109 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f546a91e-c0f2-4ccc-ab31-23b51e6e5722 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.168699 Jul 11 20:59:49.786889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 180/366] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:49 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:49.879904 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4b294235-5f84-4789-99fe-eddbb5cb81bc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:49.880685 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4b294235-5f84-4789-99fe-eddbb5cb81bc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:49.889592 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4b294235-5f84-4789-99fe-eddbb5cb81bc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:49.890281 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4b294235-5f84-4789-99fe-eddbb5cb81bc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:49.891580 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4b294235-5f84-4789-99fe-eddbb5cb81bc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:49.892019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4b294235-5f84-4789-99fe-eddbb5cb81bc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:49.976324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4b294235-5f84-4789-99fe-eddbb5cb81bc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:49.984640 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4b294235-5f84-4789-99fe-eddbb5cb81bc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1298 microversion: 2.1 time: 0.109409 Jul 11 20:59:49.985224 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 187/367] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:49 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:50.292331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9fa6c772-2500-4caf-a2c1-d54a96e5d7d3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:50.292943 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9fa6c772-2500-4caf-a2c1-d54a96e5d7d3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:50.299420 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9fa6c772-2500-4caf-a2c1-d54a96e5d7d3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:50.299912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9fa6c772-2500-4caf-a2c1-d54a96e5d7d3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:50.300706 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9fa6c772-2500-4caf-a2c1-d54a96e5d7d3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:50.301121 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9fa6c772-2500-4caf-a2c1-d54a96e5d7d3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:50.450994 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9fa6c772-2500-4caf-a2c1-d54a96e5d7d3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:50.462234 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9fa6c772-2500-4caf-a2c1-d54a96e5d7d3 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1503 microversion: 2.1 time: 0.173825 Jul 11 20:59:50.462835 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 181/368] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:50 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:50.803795 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9558a04e-664b-413a-8dd5-ffaed51165f2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:50.805445 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9558a04e-664b-413a-8dd5-ffaed51165f2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:50.814143 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9558a04e-664b-413a-8dd5-ffaed51165f2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:50.814856 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9558a04e-664b-413a-8dd5-ffaed51165f2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:50.815786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9558a04e-664b-413a-8dd5-ffaed51165f2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:50.816398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9558a04e-664b-413a-8dd5-ffaed51165f2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:50.975077 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9558a04e-664b-413a-8dd5-ffaed51165f2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:50.986062 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9558a04e-664b-413a-8dd5-ffaed51165f2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.186128 Jul 11 20:59:50.987460 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 188/369] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:50 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:51.002324 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-25c275cd-73d1-4e3d-bc28-688dfef2b330 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:51.003005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-25c275cd-73d1-4e3d-bc28-688dfef2b330 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:51.010037 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-25c275cd-73d1-4e3d-bc28-688dfef2b330 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:51.010582 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-25c275cd-73d1-4e3d-bc28-688dfef2b330 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:51.011341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-25c275cd-73d1-4e3d-bc28-688dfef2b330 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:51.011773 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-25c275cd-73d1-4e3d-bc28-688dfef2b330 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:51.100299 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-25c275cd-73d1-4e3d-bc28-688dfef2b330 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:51.112445 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-25c275cd-73d1-4e3d-bc28-688dfef2b330 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1304 microversion: 2.1 time: 0.113696 Jul 11 20:59:51.114018 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 182/370] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:50 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:51.266792 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-3a2e7228-257e-4f71-b216-8c3fc16eb50d req-0f909cce-0e40-488f-b688-5974996063b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e97b6da-f518-4292-9d9e-b99d27678b64", "name": "network-vif-deleted", "tag": "2c8b9b30-30ba-41ff-ac60-05b114ba25ae"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:51.273253 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-20154053-6fc5-4fae-b52a-5d067103eeb5 req-8ba0f761-c35d-47d9-9c95-6955965f108d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c351b1b3-411c-4042-b8a7-a8370a2f161c", "name": "network-vif-plugged", "status": "completed", "tag": "f16e4c4e-a386-47de-93b8-b66a6d98055c"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:51.285090 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-20154053-6fc5-4fae-b52a-5d067103eeb5 req-8ba0f761-c35d-47d9-9c95-6955965f108d service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:51.285779 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-3a2e7228-257e-4f71-b216-8c3fc16eb50d req-0f909cce-0e40-488f-b688-5974996063b1 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:51.286073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-20154053-6fc5-4fae-b52a-5d067103eeb5 req-8ba0f761-c35d-47d9-9c95-6955965f108d service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:51.294243 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-3a2e7228-257e-4f71-b216-8c3fc16eb50d req-0f909cce-0e40-488f-b688-5974996063b1 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:51.306674 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-20154053-6fc5-4fae-b52a-5d067103eeb5 req-8ba0f761-c35d-47d9-9c95-6955965f108d service nova] Creating event network-vif-plugged:f16e4c4e-a386-47de-93b8-b66a6d98055c for instance c351b1b3-411c-4042-b8a7-a8370a2f161c on hv-cinder-84902 Jul 11 20:59:51.314974 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-3a2e7228-257e-4f71-b216-8c3fc16eb50d req-0f909cce-0e40-488f-b688-5974996063b1 service nova] Creating event network-vif-deleted:2c8b9b30-30ba-41ff-ac60-05b114ba25ae for instance 2e97b6da-f518-4292-9d9e-b99d27678b64 on hv-cinder-84902 Jul 11 20:59:51.316294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-20154053-6fc5-4fae-b52a-5d067103eeb5 req-8ba0f761-c35d-47d9-9c95-6955965f108d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046895 Jul 11 20:59:51.316948 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 183/371] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 20:59:51.333383 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-3a2e7228-257e-4f71-b216-8c3fc16eb50d req-0f909cce-0e40-488f-b688-5974996063b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070019 Jul 11 20:59:51.334221 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 189/372] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:59:51.485556 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:51.486237 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:51.494065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:51.494970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:51.495856 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:51.496345 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:51.544816 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:51.545527 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:51.546142 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lazy-loading 'fault' on Instance uuid 2e97b6da-f518-4292-9d9e-b99d27678b64 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 20:59:51.610555 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934b314c46824d5397a0ae92bb07b725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804c8a0ad1674b818f8bbc53d661284b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:51.618216 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a2c65c39-34ad-49d6-87df-05aa98a99c18 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 200 len: 1304 microversion: 2.1 time: 0.142929 Jul 11 20:59:51.618782 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 184/373] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:51 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:52.004947 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8a4fb269-a6dd-4240-b284-4335f97a6f91 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:52.006544 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8a4fb269-a6dd-4240-b284-4335f97a6f91 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:52.013772 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8a4fb269-a6dd-4240-b284-4335f97a6f91 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:52.014473 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8a4fb269-a6dd-4240-b284-4335f97a6f91 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:52.015247 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8a4fb269-a6dd-4240-b284-4335f97a6f91 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:52.015673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8a4fb269-a6dd-4240-b284-4335f97a6f91 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:52.132759 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4d66f845-8bd8-4c0b-8c24-3610e2f56b69 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:52.133333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4d66f845-8bd8-4c0b-8c24-3610e2f56b69 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:52.140632 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4d66f845-8bd8-4c0b-8c24-3610e2f56b69 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:52.141158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4d66f845-8bd8-4c0b-8c24-3610e2f56b69 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:52.142047 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4d66f845-8bd8-4c0b-8c24-3610e2f56b69 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:52.142592 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4d66f845-8bd8-4c0b-8c24-3610e2f56b69 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:52.154972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8a4fb269-a6dd-4240-b284-4335f97a6f91 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:52.162562 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8a4fb269-a6dd-4240-b284-4335f97a6f91 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.162556 Jul 11 20:59:52.163141 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 190/374] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:51 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:52.298796 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4d66f845-8bd8-4c0b-8c24-3610e2f56b69 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:52.311698 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4d66f845-8bd8-4c0b-8c24-3610e2f56b69 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.182826 Jul 11 20:59:52.312640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 185/375] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:52 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:52.635134 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:52.635442 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] [instance: 2e97b6da-f518-4292-9d9e-b99d27678b64] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:52.642921 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:52.643369 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:52.644674 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:52.645131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:52.659408 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] HTTP exception thrown: Instance 2e97b6da-f518-4292-9d9e-b99d27678b64 could not be found. Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Request method failure captured: Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 HTTP/1.1 Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI8DwaTQqvUST5ym9P0NNmaokf2bSgNQV4mg0rtUSS8m214rrXKWOLHTsuT3eWCdUZvTscNxqXFVxtCv7Oi7-vNpPMh8Gfelf3jRIgQtU8YqFAQwi7hTFIn0vxAqIyoPSG3mTwyR_2v1wqpR6uHfwrIdO3Sh3vXh-_AfKsWYSu874Dc Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 804c8a0ad1674b818f8bbc53d661284b Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesActionsTest-417731331 Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 20:59:52.661347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/804c8a0ad1674b818f8bbc53d661284b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/804c8a0ad1674b818f8bbc53d661284b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/804c8a0ad1674b818f8bbc53d661284b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_804c8a0ad1674b818f8bbc53d661284b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesActionsTest-417731331 Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 804c8a0ad1674b818f8bbc53d661284b Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesActionsTest-417731331 Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesActionsTest-417731331-project Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 934b314c46824d5397a0ae92bb07b725 Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesActionsTest-417731331-project Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 2e97b6da-f518-4292-9d9e-b99d27678b64 could not be found. Jul 11 20:59:52.662880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '2e97b6da-f518-4292-9d9e-b99d27678b64'} Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e97b6da-f518-4292-9d9e-b99d27678b64 could not be found. Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 20:59:52.663820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e97b6da-f518-4292-9d9e-b99d27678b64 could not be found. Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e97b6da-f518-4292-9d9e-b99d27678b64 could not be found. Jul 11 20:59:52.665213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 20:59:52.666405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] Returning 404 to user: Instance 2e97b6da-f518-4292-9d9e-b99d27678b64 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 20:59:52.666405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d0638275-70ae-4279-86da-cbe2073d9901 tempest-VolumesActionsTest-417731331 tempest-VolumesActionsTest-417731331-project] 10.222.0.20 "GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64" status: 404 len: 111 microversion: 2.1 time: 0.031825 Jul 11 20:59:52.669922 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 191/376] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:52 2022] GET /compute/v2.1/servers/2e97b6da-f518-4292-9d9e-b99d27678b64 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 20:59:53.183611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-646ff530-e799-4408-83e6-d75b86de3775 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:53.184927 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-646ff530-e799-4408-83e6-d75b86de3775 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:53.193222 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-646ff530-e799-4408-83e6-d75b86de3775 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:53.194279 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-646ff530-e799-4408-83e6-d75b86de3775 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:53.202798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-646ff530-e799-4408-83e6-d75b86de3775 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:53.203456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-646ff530-e799-4408-83e6-d75b86de3775 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:53.334041 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cc12340b-9379-4869-9e36-c5db90135cfa tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:53.336448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-cc12340b-9379-4869-9e36-c5db90135cfa tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:53.344476 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cc12340b-9379-4869-9e36-c5db90135cfa tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:53.345076 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cc12340b-9379-4869-9e36-c5db90135cfa tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:53.345994 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cc12340b-9379-4869-9e36-c5db90135cfa tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:53.346853 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cc12340b-9379-4869-9e36-c5db90135cfa tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:53.354162 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:53.397683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-646ff530-e799-4408-83e6-d75b86de3775 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:53.405552 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-646ff530-e799-4408-83e6-d75b86de3775 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.228778 Jul 11 20:59:53.406117 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 186/377] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:53 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:53.411005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-dc84398e-e5fe-4a9d-bddc-c49e1dc3f068 req-57c2c7da-497d-4a39-8071-ab6d0a01ab2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fff1a4-e60c-436d-b94c-e4e414557cbe", "tag": "6b32af85-d1d7-4e52-9152-d26b348afac0"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 20:59:53.419562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-dc84398e-e5fe-4a9d-bddc-c49e1dc3f068 req-57c2c7da-497d-4a39-8071-ab6d0a01ab2f service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:53.419996 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-dc84398e-e5fe-4a9d-bddc-c49e1dc3f068 req-57c2c7da-497d-4a39-8071-ab6d0a01ab2f service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:53.432058 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-dc84398e-e5fe-4a9d-bddc-c49e1dc3f068 req-57c2c7da-497d-4a39-8071-ab6d0a01ab2f service nova] Creating event network-changed:6b32af85-d1d7-4e52-9152-d26b348afac0 for instance 49fff1a4-e60c-436d-b94c-e4e414557cbe on hv-cinder-84902 Jul 11 20:59:53.438780 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-dc84398e-e5fe-4a9d-bddc-c49e1dc3f068 req-57c2c7da-497d-4a39-8071-ab6d0a01ab2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031252 Jul 11 20:59:53.439457 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 187/378] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 20:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 20:59:53.508139 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-cc12340b-9379-4869-9e36-c5db90135cfa tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:53.515729 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-cc12340b-9379-4869-9e36-c5db90135cfa tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.186310 Jul 11 20:59:53.516331 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 192/379] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:53 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:54.428254 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d93e38b3-6191-460b-a06a-d14d114f3a28 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:54.429394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d93e38b3-6191-460b-a06a-d14d114f3a28 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:54.437422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d93e38b3-6191-460b-a06a-d14d114f3a28 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:54.437855 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d93e38b3-6191-460b-a06a-d14d114f3a28 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:54.438602 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d93e38b3-6191-460b-a06a-d14d114f3a28 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:54.439024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d93e38b3-6191-460b-a06a-d14d114f3a28 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:54.532606 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-acc2387c-37c3-41ab-939f-ea6e0d2d8295 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:54.533212 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-acc2387c-37c3-41ab-939f-ea6e0d2d8295 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:54.539619 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-acc2387c-37c3-41ab-939f-ea6e0d2d8295 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:54.540060 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-acc2387c-37c3-41ab-939f-ea6e0d2d8295 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:54.540852 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-acc2387c-37c3-41ab-939f-ea6e0d2d8295 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:54.541326 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-acc2387c-37c3-41ab-939f-ea6e0d2d8295 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:54.574727 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d93e38b3-6191-460b-a06a-d14d114f3a28 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:54.582380 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d93e38b3-6191-460b-a06a-d14d114f3a28 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.162070 Jul 11 20:59:54.582954 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 188/380] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:54 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:54.675346 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-acc2387c-37c3-41ab-939f-ea6e0d2d8295 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:54.683699 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-acc2387c-37c3-41ab-939f-ea6e0d2d8295 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.155008 Jul 11 20:59:54.686719 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 193/381] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:54 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:55.602817 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2074bebc-4a85-4ea7-a382-f28ad2a957d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:55.603850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2074bebc-4a85-4ea7-a382-f28ad2a957d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:55.607311 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:55.609144 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=26 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:55.618825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2074bebc-4a85-4ea7-a382-f28ad2a957d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:55.619701 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2074bebc-4a85-4ea7-a382-f28ad2a957d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:55.620503 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2074bebc-4a85-4ea7-a382-f28ad2a957d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:55.620937 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2074bebc-4a85-4ea7-a382-f28ad2a957d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:55.702800 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3b2a78f6-4cbc-4095-8809-97eddd484b8c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:55.703406 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3b2a78f6-4cbc-4095-8809-97eddd484b8c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:55.705631 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:55.711276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b2a78f6-4cbc-4095-8809-97eddd484b8c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:55.711977 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b2a78f6-4cbc-4095-8809-97eddd484b8c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:55.716684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b2a78f6-4cbc-4095-8809-97eddd484b8c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:55.717261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b2a78f6-4cbc-4095-8809-97eddd484b8c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:55.757154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2074bebc-4a85-4ea7-a382-f28ad2a957d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:55.765217 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2074bebc-4a85-4ea7-a382-f28ad2a957d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.168944 Jul 11 20:59:55.765790 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 189/382] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:55 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:55.852126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3b2a78f6-4cbc-4095-8809-97eddd484b8c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:55.859640 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3b2a78f6-4cbc-4095-8809-97eddd484b8c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.160646 Jul 11 20:59:55.860396 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 194/383] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:55 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:56.782552 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0c530275-f441-4700-aa28-8627632b4e25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:56.783050 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0c530275-f441-4700-aa28-8627632b4e25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:56.790043 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0c530275-f441-4700-aa28-8627632b4e25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:56.790488 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0c530275-f441-4700-aa28-8627632b4e25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:56.791316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0c530275-f441-4700-aa28-8627632b4e25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:56.791752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0c530275-f441-4700-aa28-8627632b4e25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:56.879282 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2ca4e48c-426c-44c2-ba78-68d4727c701d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:56.879893 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2ca4e48c-426c-44c2-ba78-68d4727c701d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:56.886386 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2ca4e48c-426c-44c2-ba78-68d4727c701d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:56.886832 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2ca4e48c-426c-44c2-ba78-68d4727c701d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:56.887683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2ca4e48c-426c-44c2-ba78-68d4727c701d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:56.888051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2ca4e48c-426c-44c2-ba78-68d4727c701d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:56.933523 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0c530275-f441-4700-aa28-8627632b4e25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:56.943143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0c530275-f441-4700-aa28-8627632b4e25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.164196 Jul 11 20:59:56.944134 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 190/384] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:56 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:57.024878 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2ca4e48c-426c-44c2-ba78-68d4727c701d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:57.032489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2ca4e48c-426c-44c2-ba78-68d4727c701d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.157187 Jul 11 20:59:57.033122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 195/385] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:56 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 20:59:57.960351 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fb88b3e6-17c5-4444-b137-411351e91f5e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:57.961053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fb88b3e6-17c5-4444-b137-411351e91f5e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:57.968226 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fb88b3e6-17c5-4444-b137-411351e91f5e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:57.968675 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fb88b3e6-17c5-4444-b137-411351e91f5e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:57.969679 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fb88b3e6-17c5-4444-b137-411351e91f5e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:57.970500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fb88b3e6-17c5-4444-b137-411351e91f5e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:58.049694 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4e0b3f32-b205-43b8-8c1b-3deb6f7bfd65 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:58.050260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4e0b3f32-b205-43b8-8c1b-3deb6f7bfd65 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:58.057336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4e0b3f32-b205-43b8-8c1b-3deb6f7bfd65 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:58.057528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4e0b3f32-b205-43b8-8c1b-3deb6f7bfd65 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:58.058244 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4e0b3f32-b205-43b8-8c1b-3deb6f7bfd65 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:58.058671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4e0b3f32-b205-43b8-8c1b-3deb6f7bfd65 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:58.114165 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fb88b3e6-17c5-4444-b137-411351e91f5e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:58.122233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fb88b3e6-17c5-4444-b137-411351e91f5e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.165934 Jul 11 20:59:58.122778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 191/386] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:57 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:58.193998 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4e0b3f32-b205-43b8-8c1b-3deb6f7bfd65 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:58.201971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4e0b3f32-b205-43b8-8c1b-3deb6f7bfd65 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.156330 Jul 11 20:59:58.202547 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 196/387] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:58 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:59.140252 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-502d4808-4db7-4c05-b796-877eda02df87 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:59.140839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-502d4808-4db7-4c05-b796-877eda02df87 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:59.148133 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-502d4808-4db7-4c05-b796-877eda02df87 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:59.148610 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-502d4808-4db7-4c05-b796-877eda02df87 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:59.149404 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-502d4808-4db7-4c05-b796-877eda02df87 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:59.149850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-502d4808-4db7-4c05-b796-877eda02df87 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:59.218364 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-da0c099a-c54f-474e-8007-90c44988c9f0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 20:59:59.218926 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-da0c099a-c54f-474e-8007-90c44988c9f0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 20:59:59.225258 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-da0c099a-c54f-474e-8007-90c44988c9f0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:59.225697 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-da0c099a-c54f-474e-8007-90c44988c9f0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:59.226463 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-da0c099a-c54f-474e-8007-90c44988c9f0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 20:59:59.226880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-da0c099a-c54f-474e-8007-90c44988c9f0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 20:59:59.288737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-502d4808-4db7-4c05-b796-877eda02df87 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:59.296290 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-502d4808-4db7-4c05-b796-877eda02df87 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.160192 Jul 11 20:59:59.297084 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 192/388] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:59 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 20:59:59.357153 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-da0c099a-c54f-474e-8007-90c44988c9f0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 20:59:59.365046 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-da0c099a-c54f-474e-8007-90c44988c9f0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.150731 Jul 11 20:59:59.365594 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 197/389] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 20:59:59 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:00:00.318402 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9609a29c-b43b-4916-ab5c-f3b4bfcadd32 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:00.319375 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9609a29c-b43b-4916-ab5c-f3b4bfcadd32 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:00.329615 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9609a29c-b43b-4916-ab5c-f3b4bfcadd32 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:00.330348 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9609a29c-b43b-4916-ab5c-f3b4bfcadd32 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:00.331586 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9609a29c-b43b-4916-ab5c-f3b4bfcadd32 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:00.332347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9609a29c-b43b-4916-ab5c-f3b4bfcadd32 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:00.383221 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9efe0096-ac62-4485-86a7-b75eca3492c9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:00.383845 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9efe0096-ac62-4485-86a7-b75eca3492c9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:00.390765 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9efe0096-ac62-4485-86a7-b75eca3492c9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:00.391280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9efe0096-ac62-4485-86a7-b75eca3492c9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:00.392040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9efe0096-ac62-4485-86a7-b75eca3492c9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:00.392504 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9efe0096-ac62-4485-86a7-b75eca3492c9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:00.465411 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9609a29c-b43b-4916-ab5c-f3b4bfcadd32 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:00.473139 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9609a29c-b43b-4916-ab5c-f3b4bfcadd32 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.161544 Jul 11 21:00:00.473704 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 193/390] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:00 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:00.522428 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9efe0096-ac62-4485-86a7-b75eca3492c9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:00.531787 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9efe0096-ac62-4485-86a7-b75eca3492c9 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.152396 Jul 11 21:00:00.532635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 198/391] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:00 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:01.495093 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4a9c5f23-bb92-4fc6-b55f-03d76a5ca8f0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:01.496024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4a9c5f23-bb92-4fc6-b55f-03d76a5ca8f0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:01.506891 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4a9c5f23-bb92-4fc6-b55f-03d76a5ca8f0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:01.507636 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4a9c5f23-bb92-4fc6-b55f-03d76a5ca8f0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:01.508956 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4a9c5f23-bb92-4fc6-b55f-03d76a5ca8f0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:01.509667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4a9c5f23-bb92-4fc6-b55f-03d76a5ca8f0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:01.549081 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fe4924e9-393f-4088-9231-6d5c3e0bd261 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:01.549649 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fe4924e9-393f-4088-9231-6d5c3e0bd261 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:01.556460 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe4924e9-393f-4088-9231-6d5c3e0bd261 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:01.556911 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe4924e9-393f-4088-9231-6d5c3e0bd261 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:01.557728 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe4924e9-393f-4088-9231-6d5c3e0bd261 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:01.558168 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe4924e9-393f-4088-9231-6d5c3e0bd261 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:01.645277 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4a9c5f23-bb92-4fc6-b55f-03d76a5ca8f0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:01.653643 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4a9c5f23-bb92-4fc6-b55f-03d76a5ca8f0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1318 microversion: 2.1 time: 0.165423 Jul 11 21:00:01.654251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 194/392] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:01 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:01.695345 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fe4924e9-393f-4088-9231-6d5c3e0bd261 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:01.703387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fe4924e9-393f-4088-9231-6d5c3e0bd261 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.158188 Jul 11 21:00:01.703953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 199/393] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:01 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:02.670828 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-114fb1aa-dca7-4d62-9624-4bb5f5aa0d2c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:02.671533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-114fb1aa-dca7-4d62-9624-4bb5f5aa0d2c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:02.678318 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-114fb1aa-dca7-4d62-9624-4bb5f5aa0d2c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:02.678758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-114fb1aa-dca7-4d62-9624-4bb5f5aa0d2c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:02.679545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-114fb1aa-dca7-4d62-9624-4bb5f5aa0d2c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:02.680496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-114fb1aa-dca7-4d62-9624-4bb5f5aa0d2c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:02.719706 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4511a73d-460e-4160-a9b9-b2a73b62245e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:02.720279 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4511a73d-460e-4160-a9b9-b2a73b62245e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:02.726761 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4511a73d-460e-4160-a9b9-b2a73b62245e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:02.727290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4511a73d-460e-4160-a9b9-b2a73b62245e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:02.728198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4511a73d-460e-4160-a9b9-b2a73b62245e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:02.728708 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4511a73d-460e-4160-a9b9-b2a73b62245e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:02.811679 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-114fb1aa-dca7-4d62-9624-4bb5f5aa0d2c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:02.819514 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-114fb1aa-dca7-4d62-9624-4bb5f5aa0d2c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1505 microversion: 2.1 time: 0.152679 Jul 11 21:00:02.820094 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 195/394] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:02 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:02.861821 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4511a73d-460e-4160-a9b9-b2a73b62245e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:02.869585 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4511a73d-460e-4160-a9b9-b2a73b62245e tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.153874 Jul 11 21:00:02.870499 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 200/395] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:02 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:03.890904 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8730249e-b7c9-4d8f-8206-6bea9ac1ef26 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:03.891769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8730249e-b7c9-4d8f-8206-6bea9ac1ef26 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:03.902878 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8730249e-b7c9-4d8f-8206-6bea9ac1ef26 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:03.903450 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8730249e-b7c9-4d8f-8206-6bea9ac1ef26 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:03.904234 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8730249e-b7c9-4d8f-8206-6bea9ac1ef26 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:03.904665 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8730249e-b7c9-4d8f-8206-6bea9ac1ef26 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:04.053815 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8730249e-b7c9-4d8f-8206-6bea9ac1ef26 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:04.061912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8730249e-b7c9-4d8f-8206-6bea9ac1ef26 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.177744 Jul 11 21:00:04.062481 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 196/396] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:03 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:05.083411 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-321a0725-bf86-4895-bf94-332c1cea73bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:05.084359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-321a0725-bf86-4895-bf94-332c1cea73bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:05.095044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-321a0725-bf86-4895-bf94-332c1cea73bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:05.095793 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-321a0725-bf86-4895-bf94-332c1cea73bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:05.097104 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-321a0725-bf86-4895-bf94-332c1cea73bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:05.097836 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-321a0725-bf86-4895-bf94-332c1cea73bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:05.256290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-321a0725-bf86-4895-bf94-332c1cea73bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:05.267931 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-321a0725-bf86-4895-bf94-332c1cea73bd tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.190865 Jul 11 21:00:05.268902 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 201/397] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:05 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:06.292305 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0adcd8b3-c54e-45f8-a837-9a0620c10db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:06.292914 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0adcd8b3-c54e-45f8-a837-9a0620c10db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:06.303160 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0adcd8b3-c54e-45f8-a837-9a0620c10db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:06.303728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0adcd8b3-c54e-45f8-a837-9a0620c10db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:06.304993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0adcd8b3-c54e-45f8-a837-9a0620c10db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:06.305613 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0adcd8b3-c54e-45f8-a837-9a0620c10db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:06.446556 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0adcd8b3-c54e-45f8-a837-9a0620c10db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:06.454437 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0adcd8b3-c54e-45f8-a837-9a0620c10db4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.168417 Jul 11 21:00:06.455014 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 197/398] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:06 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:07.471331 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1ab6b202-1d20-4c19-a0ac-8a3ad0a34eda tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:07.472029 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1ab6b202-1d20-4c19-a0ac-8a3ad0a34eda tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:07.478391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1ab6b202-1d20-4c19-a0ac-8a3ad0a34eda tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:07.478865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1ab6b202-1d20-4c19-a0ac-8a3ad0a34eda tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:07.479617 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1ab6b202-1d20-4c19-a0ac-8a3ad0a34eda tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:07.480028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1ab6b202-1d20-4c19-a0ac-8a3ad0a34eda tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:07.619872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1ab6b202-1d20-4c19-a0ac-8a3ad0a34eda tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:07.629105 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1ab6b202-1d20-4c19-a0ac-8a3ad0a34eda tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.161798 Jul 11 21:00:07.629675 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 202/399] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:07 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:08.646637 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-257478e6-d91c-4649-8ae2-b4c3f369cc01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:08.647231 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-257478e6-d91c-4649-8ae2-b4c3f369cc01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:08.654306 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-257478e6-d91c-4649-8ae2-b4c3f369cc01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:08.654805 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-257478e6-d91c-4649-8ae2-b4c3f369cc01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:08.655527 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-257478e6-d91c-4649-8ae2-b4c3f369cc01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:08.655960 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-257478e6-d91c-4649-8ae2-b4c3f369cc01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:08.662925 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:08.795706 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-257478e6-d91c-4649-8ae2-b4c3f369cc01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:08.806434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-257478e6-d91c-4649-8ae2-b4c3f369cc01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.163243 Jul 11 21:00:08.807425 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 198/400] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:08 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:09.826490 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3949da23-a29c-42ea-9556-b285dd99e647 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:09.827432 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3949da23-a29c-42ea-9556-b285dd99e647 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:09.833680 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3949da23-a29c-42ea-9556-b285dd99e647 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:09.834199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3949da23-a29c-42ea-9556-b285dd99e647 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:09.835170 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3949da23-a29c-42ea-9556-b285dd99e647 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:09.835663 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3949da23-a29c-42ea-9556-b285dd99e647 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:09.981578 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3949da23-a29c-42ea-9556-b285dd99e647 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:09.989276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3949da23-a29c-42ea-9556-b285dd99e647 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.166830 Jul 11 21:00:09.989809 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 203/401] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:09 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:11.007429 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-dc83f148-7001-4f3d-a104-832821ae176a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:11.007973 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-dc83f148-7001-4f3d-a104-832821ae176a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:11.014287 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dc83f148-7001-4f3d-a104-832821ae176a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:11.014718 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dc83f148-7001-4f3d-a104-832821ae176a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:11.015671 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dc83f148-7001-4f3d-a104-832821ae176a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:11.016101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dc83f148-7001-4f3d-a104-832821ae176a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:11.161070 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-dc83f148-7001-4f3d-a104-832821ae176a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:11.169520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-dc83f148-7001-4f3d-a104-832821ae176a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.166825 Jul 11 21:00:11.170285 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 199/402] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:11 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:12.188805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7e5fd1b2-3f7e-4e96-b350-a9fe4eb9bb7f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:12.189440 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7e5fd1b2-3f7e-4e96-b350-a9fe4eb9bb7f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:12.196142 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1b2-3f7e-4e96-b350-a9fe4eb9bb7f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:12.196613 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1b2-3f7e-4e96-b350-a9fe4eb9bb7f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:12.197384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1b2-3f7e-4e96-b350-a9fe4eb9bb7f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:12.197812 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1b2-3f7e-4e96-b350-a9fe4eb9bb7f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:12.334509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7e5fd1b2-3f7e-4e96-b350-a9fe4eb9bb7f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:12.346933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7e5fd1b2-3f7e-4e96-b350-a9fe4eb9bb7f tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.161859 Jul 11 21:00:12.347807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 204/403] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:12 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:13.373123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-91ca143d-32a6-409f-be31-a78114dbe0d2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:13.374467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-91ca143d-32a6-409f-be31-a78114dbe0d2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:13.386421 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-91ca143d-32a6-409f-be31-a78114dbe0d2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:13.386871 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-91ca143d-32a6-409f-be31-a78114dbe0d2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:13.392501 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-91ca143d-32a6-409f-be31-a78114dbe0d2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:13.393128 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-91ca143d-32a6-409f-be31-a78114dbe0d2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:13.572563 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-91ca143d-32a6-409f-be31-a78114dbe0d2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:13.580475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-91ca143d-32a6-409f-be31-a78114dbe0d2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.211548 Jul 11 21:00:13.581114 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 200/404] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:13 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:14.603230 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5407b6f2-ab4a-4860-9795-62366cb082f4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:14.603858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5407b6f2-ab4a-4860-9795-62366cb082f4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:14.611590 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5407b6f2-ab4a-4860-9795-62366cb082f4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:14.612803 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5407b6f2-ab4a-4860-9795-62366cb082f4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:14.613830 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5407b6f2-ab4a-4860-9795-62366cb082f4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:14.614515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5407b6f2-ab4a-4860-9795-62366cb082f4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:14.769451 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5407b6f2-ab4a-4860-9795-62366cb082f4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:14.779627 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5407b6f2-ab4a-4860-9795-62366cb082f4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.186431 Jul 11 21:00:14.780251 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 205/405] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:14 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:15.798298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6fa539e2-a789-4453-98ce-6d789582735d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:15.799732 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6fa539e2-a789-4453-98ce-6d789582735d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:15.801917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:15.811389 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fa539e2-a789-4453-98ce-6d789582735d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:15.811741 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fa539e2-a789-4453-98ce-6d789582735d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:15.812579 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fa539e2-a789-4453-98ce-6d789582735d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:15.813262 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fa539e2-a789-4453-98ce-6d789582735d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:15.967649 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6fa539e2-a789-4453-98ce-6d789582735d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:15.977779 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6fa539e2-a789-4453-98ce-6d789582735d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.184414 Jul 11 21:00:15.978605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 201/406] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:15 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:16.996692 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-da5fb828-fbeb-4b63-a4f7-55aa378f0bc4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:16.997613 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-da5fb828-fbeb-4b63-a4f7-55aa378f0bc4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:17.011760 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-da5fb828-fbeb-4b63-a4f7-55aa378f0bc4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:17.012506 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-da5fb828-fbeb-4b63-a4f7-55aa378f0bc4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:17.013626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-da5fb828-fbeb-4b63-a4f7-55aa378f0bc4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:17.014085 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-da5fb828-fbeb-4b63-a4f7-55aa378f0bc4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:17.162785 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-da5fb828-fbeb-4b63-a4f7-55aa378f0bc4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:17.170793 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-da5fb828-fbeb-4b63-a4f7-55aa378f0bc4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.178419 Jul 11 21:00:17.171665 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 206/407] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:16 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:18.188446 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c0aa3a4c-72b7-426a-ab2e-8095705e831a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:18.189841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c0aa3a4c-72b7-426a-ab2e-8095705e831a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:18.196840 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c0aa3a4c-72b7-426a-ab2e-8095705e831a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:18.197385 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c0aa3a4c-72b7-426a-ab2e-8095705e831a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:18.198156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c0aa3a4c-72b7-426a-ab2e-8095705e831a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:18.198589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c0aa3a4c-72b7-426a-ab2e-8095705e831a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:18.350990 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c0aa3a4c-72b7-426a-ab2e-8095705e831a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:18.359841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c0aa3a4c-72b7-426a-ab2e-8095705e831a tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.175216 Jul 11 21:00:18.360723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 202/408] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:18 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:19.376979 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c02584b5-f1b9-4d21-83c8-ffcbbf3bc863 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:19.378645 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c02584b5-f1b9-4d21-83c8-ffcbbf3bc863 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:19.385182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c02584b5-f1b9-4d21-83c8-ffcbbf3bc863 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:19.385846 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c02584b5-f1b9-4d21-83c8-ffcbbf3bc863 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:19.386813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c02584b5-f1b9-4d21-83c8-ffcbbf3bc863 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:19.387437 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c02584b5-f1b9-4d21-83c8-ffcbbf3bc863 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:19.534714 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c02584b5-f1b9-4d21-83c8-ffcbbf3bc863 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:19.545992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c02584b5-f1b9-4d21-83c8-ffcbbf3bc863 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.172751 Jul 11 21:00:19.547006 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 207/409] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:19 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:20.563605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-30c93326-642f-48f8-ad2e-c0fbf9fe7687 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:20.564195 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-30c93326-642f-48f8-ad2e-c0fbf9fe7687 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:20.571805 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30c93326-642f-48f8-ad2e-c0fbf9fe7687 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:20.572277 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30c93326-642f-48f8-ad2e-c0fbf9fe7687 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:20.573268 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30c93326-642f-48f8-ad2e-c0fbf9fe7687 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:20.573682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30c93326-642f-48f8-ad2e-c0fbf9fe7687 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:20.748856 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-30c93326-642f-48f8-ad2e-c0fbf9fe7687 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:20.762072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-30c93326-642f-48f8-ad2e-c0fbf9fe7687 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.202373 Jul 11 21:00:20.762659 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 203/410] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:20 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:21.348225 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-db29f702-cf92-49d3-99ba-033eb17e2b82 req-2f8e3531-7b75-4fb1-8402-5023ddcae023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fff1a4-e60c-436d-b94c-e4e414557cbe", "name": "network-vif-plugged", "status": "completed", "tag": "6b32af85-d1d7-4e52-9152-d26b348afac0"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:00:21.358512 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-db29f702-cf92-49d3-99ba-033eb17e2b82 req-2f8e3531-7b75-4fb1-8402-5023ddcae023 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:21.359153 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-db29f702-cf92-49d3-99ba-033eb17e2b82 req-2f8e3531-7b75-4fb1-8402-5023ddcae023 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:21.372355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-db29f702-cf92-49d3-99ba-033eb17e2b82 req-2f8e3531-7b75-4fb1-8402-5023ddcae023 service nova] Creating event network-vif-plugged:6b32af85-d1d7-4e52-9152-d26b348afac0 for instance 49fff1a4-e60c-436d-b94c-e4e414557cbe on hv-cinder-84902 Jul 11 21:00:21.378863 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-db29f702-cf92-49d3-99ba-033eb17e2b82 req-2f8e3531-7b75-4fb1-8402-5023ddcae023 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034982 Jul 11 21:00:21.380277 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 208/411] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:00:21.779501 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-71049db7-8e79-4599-87f0-e893073925a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:21.780264 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-71049db7-8e79-4599-87f0-e893073925a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:21.787899 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-71049db7-8e79-4599-87f0-e893073925a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:21.788769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-71049db7-8e79-4599-87f0-e893073925a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:21.789788 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-71049db7-8e79-4599-87f0-e893073925a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:21.790226 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-71049db7-8e79-4599-87f0-e893073925a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:22.187802 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-71049db7-8e79-4599-87f0-e893073925a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:22.196174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-71049db7-8e79-4599-87f0-e893073925a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.421169 Jul 11 21:00:22.197207 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 204/412] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:21 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:23.214616 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fbe8c536-9e65-4e20-a144-fa1e1bad94a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:23.216007 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fbe8c536-9e65-4e20-a144-fa1e1bad94a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:23.222849 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fbe8c536-9e65-4e20-a144-fa1e1bad94a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:23.223188 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fbe8c536-9e65-4e20-a144-fa1e1bad94a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:23.224032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fbe8c536-9e65-4e20-a144-fa1e1bad94a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:23.224515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fbe8c536-9e65-4e20-a144-fa1e1bad94a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:23.243668 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=100 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:23.443100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fbe8c536-9e65-4e20-a144-fa1e1bad94a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:23.453655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fbe8c536-9e65-4e20-a144-fa1e1bad94a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1372 microversion: 2.1 time: 0.243318 Jul 11 21:00:23.464337 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 209/413] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:23 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:24.470835 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8f411b2a-1c13-40af-b5ce-5a0bbd489741 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:24.471461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8f411b2a-1c13-40af-b5ce-5a0bbd489741 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:24.478830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8f411b2a-1c13-40af-b5ce-5a0bbd489741 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:24.479563 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8f411b2a-1c13-40af-b5ce-5a0bbd489741 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:24.480563 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8f411b2a-1c13-40af-b5ce-5a0bbd489741 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:24.481163 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8f411b2a-1c13-40af-b5ce-5a0bbd489741 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:24.642138 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8f411b2a-1c13-40af-b5ce-5a0bbd489741 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:00:24.659551 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8f411b2a-1c13-40af-b5ce-5a0bbd489741 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1566 microversion: 2.1 time: 0.192529 Jul 11 21:00:24.660464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 205/414] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:00:24 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:00:24.677010 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1fd49c22-2398-497f-9260-da805ff4cd55 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:00:24.677644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1fd49c22-2398-497f-9260-da805ff4cd55 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:24.688483 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1fd49c22-2398-497f-9260-da805ff4cd55 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:24.689098 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1fd49c22-2398-497f-9260-da805ff4cd55 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:24.690008 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1fd49c22-2398-497f-9260-da805ff4cd55 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:24.690532 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1fd49c22-2398-497f-9260-da805ff4cd55 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:24.789673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1fd49c22-2398-497f-9260-da805ff4cd55 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116616 Jul 11 21:00:24.796706 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 210/415] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jul 11 21:00:24 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:00:26.752015 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-4cb55d7c-3fe0-4ae9-81cb-48d6e10da199 req-766c19b9-9f79-43ff-ad21-537314f7ff55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fff1a4-e60c-436d-b94c-e4e414557cbe", "tag": "6b32af85-d1d7-4e52-9152-d26b348afac0"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:00:26.761786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-4cb55d7c-3fe0-4ae9-81cb-48d6e10da199 req-766c19b9-9f79-43ff-ad21-537314f7ff55 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:26.762255 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-4cb55d7c-3fe0-4ae9-81cb-48d6e10da199 req-766c19b9-9f79-43ff-ad21-537314f7ff55 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:26.781087 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-4cb55d7c-3fe0-4ae9-81cb-48d6e10da199 req-766c19b9-9f79-43ff-ad21-537314f7ff55 service nova] Creating event network-changed:6b32af85-d1d7-4e52-9152-d26b348afac0 for instance 49fff1a4-e60c-436d-b94c-e4e414557cbe on hv-cinder-84902 Jul 11 21:00:26.789233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-4cb55d7c-3fe0-4ae9-81cb-48d6e10da199 req-766c19b9-9f79-43ff-ad21-537314f7ff55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040475 Jul 11 21:00:26.790419 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 206/416] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:00:39.257202 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=33 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:39.258353 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=6 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:39.435730 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-bc42a278-13d8-4792-b656-c7a6a8d45adc tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Action: 'create', calling method: .version_select at 0x7f384061a310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-538925586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4WWIAdJSST27r+soPYC0xf2fzJ5hzrZU5pBqCtR1DE7K0vqsqaURwpz2zfHb06zBWZoqAvDMF0lEOZhowf4PogjfsEDLyGBpZXv8wjrbDM2UJnT2g+mKVGnyrnOb9MvQ=="}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:00:39.450594 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-bc42a278-13d8-4792-b656-c7a6a8d45adc tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Getting quotas for project 6ed25b82be2043b188d2682a5c01490a. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:00:39.454506 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-bc42a278-13d8-4792-b656-c7a6a8d45adc tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Getting quotas for user 5f8c2e5e6c1b4833b0e9af0de8814d13 and project 6ed25b82be2043b188d2682a5c01490a. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:00:39.466862 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc42a278-13d8-4792-b656-c7a6a8d45adc tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [b73f670a-fd50-465c-abf2-7c9bc2beb1e5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 21:00:40.477732 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO oslo.messaging._drivers.impl_rabbit [None req-bc42a278-13d8-4792-b656-c7a6a8d45adc tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [b73f670a-fd50-465c-abf2-7c9bc2beb1e5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41590. Jul 11 21:00:40.499466 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-bc42a278-13d8-4792-b656-c7a6a8d45adc tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.243163 Jul 11 21:00:40.500188 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 211/417] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 21:00:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:00:41.714280 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8b07381c-4160-4ff8-a14e-54d2da31efd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baa30467-87e9-4ce7-b20c-0e8915700190", "device": "/dev/sdb"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:00:41.717488 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8b07381c-4160-4ff8-a14e-54d2da31efd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:00:41.724524 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=11 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:41.726393 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=48 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:41.730464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b07381c-4160-4ff8-a14e-54d2da31efd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:41.730903 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b07381c-4160-4ff8-a14e-54d2da31efd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:41.731952 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b07381c-4160-4ff8-a14e-54d2da31efd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:00:41.732171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b07381c-4160-4ff8-a14e-54d2da31efd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:00:42.121599 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8b07381c-4160-4ff8-a14e-54d2da31efd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "POST /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417246 Jul 11 21:00:42.123004 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 207/418] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:00:41 2022] POST /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:00:52.298403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:00:52.299290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Mon Jul 11 21:00:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:01:16.391844 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=4 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:16.392623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:16.396993 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e221200e-9ffd-452b-9bb7-4676f5c09360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:16.397631 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e221200e-9ffd-452b-9bb7-4676f5c09360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:16.405607 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e221200e-9ffd-452b-9bb7-4676f5c09360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:16.406078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e221200e-9ffd-452b-9bb7-4676f5c09360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:16.406829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e221200e-9ffd-452b-9bb7-4676f5c09360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:16.407253 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e221200e-9ffd-452b-9bb7-4676f5c09360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:16.546505 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-e221200e-9ffd-452b-9bb7-4676f5c09360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lazy-loading 'services' on Instance uuid c351b1b3-411c-4042-b8a7-a8370a2f161c {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:01:16.668695 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e221200e-9ffd-452b-9bb7-4676f5c09360 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c/os-volume_attachments/baa30467-87e9-4ce7-b20c-0e8915700190" status: 202 len: 0 microversion: 2.1 time: 0.277452 Jul 11 21:01:16.669288 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 212/419] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:01:16 2022] DELETE /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c/os-volume_attachments/baa30467-87e9-4ce7-b20c-0e8915700190 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:01:18.849033 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6611ab70-5989-436b-89b9-cfe9858a2210 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:18.849603 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6611ab70-5989-436b-89b9-cfe9858a2210 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:18.852431 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:18.853117 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:18.859740 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6611ab70-5989-436b-89b9-cfe9858a2210 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:18.860204 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6611ab70-5989-436b-89b9-cfe9858a2210 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:18.860959 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6611ab70-5989-436b-89b9-cfe9858a2210 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:18.861390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6611ab70-5989-436b-89b9-cfe9858a2210 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:18.887885 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6611ab70-5989-436b-89b9-cfe9858a2210 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:01:18.982005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6611ab70-5989-436b-89b9-cfe9858a2210 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 204 len: 0 microversion: 2.1 time: 0.136894 Jul 11 21:01:18.982623 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 208/420] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:01:18 2022] DELETE /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:01:18.991571 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cbe6303c-7f77-4526-a2eb-3025da8f3768 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:18.992303 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-cbe6303c-7f77-4526-a2eb-3025da8f3768 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:18.999120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cbe6303c-7f77-4526-a2eb-3025da8f3768 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:18.999600 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cbe6303c-7f77-4526-a2eb-3025da8f3768 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:19.000397 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cbe6303c-7f77-4526-a2eb-3025da8f3768 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:19.000834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cbe6303c-7f77-4526-a2eb-3025da8f3768 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:19.134260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-cbe6303c-7f77-4526-a2eb-3025da8f3768 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:19.141798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-cbe6303c-7f77-4526-a2eb-3025da8f3768 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1511 microversion: 2.1 time: 0.154461 Jul 11 21:01:19.142368 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 213/421] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:18 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:19.161806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-436471539", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-538925586", "security_groups": [{"name": "tempest-secgroup-smoke-1512411600"}], "block_device_mapping_v2": [{"uuid": "5f99483d-3163-4461-af30-5e718cfbbcdc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa18e945-a5c1-46c3-85a2-9a904972193b"}]}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:19.290138 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] validate_networks() for [('fa18e945-a5c1-46c3-85a2-9a904972193b', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:01:19.680441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:01:19.680860 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:01:19.681325 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:01:19.681728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:01:19.682124 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:01:19.692510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:19.692946 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:19.693725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:19.694145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:19.712335 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Getting quotas for project 6ed25b82be2043b188d2682a5c01490a. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:01:19.716403 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Getting quotas for user 5f8c2e5e6c1b4833b0e9af0de8814d13 and project 6ed25b82be2043b188d2682a5c01490a. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:01:19.774573 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:01:19.776767 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f99483d-3163-4461-af30-5e718cfbbcdc',volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:01:19.910451 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a09c9447-a86d-4a80-a9a5-0f54ff5db962 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.752786 Jul 11 21:01:19.911130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 209/422] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:01:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:01:19.921399 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-bfc9c64a-5641-4c24-8464-88209ce19d32 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:19.921975 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-bfc9c64a-5641-4c24-8464-88209ce19d32 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:19.979112 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-bfc9c64a-5641-4c24-8464-88209ce19d32 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:19.986037 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-bfc9c64a-5641-4c24-8464-88209ce19d32 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1093 microversion: 2.1 time: 0.068541 Jul 11 21:01:19.986609 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 214/423] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:19 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:20.159406 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-673720ce-c9eb-424d-ab26-ef3292f76fc0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:20.160243 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-673720ce-c9eb-424d-ab26-ef3292f76fc0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:20.168241 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-673720ce-c9eb-424d-ab26-ef3292f76fc0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:20.168723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-673720ce-c9eb-424d-ab26-ef3292f76fc0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:20.169636 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-673720ce-c9eb-424d-ab26-ef3292f76fc0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:20.170076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-673720ce-c9eb-424d-ab26-ef3292f76fc0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:20.311294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-673720ce-c9eb-424d-ab26-ef3292f76fc0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:20.318833 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-673720ce-c9eb-424d-ab26-ef3292f76fc0 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1511 microversion: 2.1 time: 0.163458 Jul 11 21:01:20.319433 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 210/424] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:20 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:20.833823 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-13d4cc65-5a51-4d70-87ee-5a1316886703 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:20.834346 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-13d4cc65-5a51-4d70-87ee-5a1316886703 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:20.840391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13d4cc65-5a51-4d70-87ee-5a1316886703 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:20.840834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13d4cc65-5a51-4d70-87ee-5a1316886703 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:20.841600 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13d4cc65-5a51-4d70-87ee-5a1316886703 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:20.842037 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13d4cc65-5a51-4d70-87ee-5a1316886703 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:20.865053 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-13d4cc65-5a51-4d70-87ee-5a1316886703 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/ips" status: 200 len: 145 microversion: 2.1 time: 0.035350 Jul 11 21:01:20.865586 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 215/425] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 21:01:20 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:01:21.003157 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6fe9155b-3185-47d3-90fe-be3a76993848 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:21.003765 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6fe9155b-3185-47d3-90fe-be3a76993848 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:21.010815 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fe9155b-3185-47d3-90fe-be3a76993848 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:21.011253 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fe9155b-3185-47d3-90fe-be3a76993848 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:21.011996 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fe9155b-3185-47d3-90fe-be3a76993848 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:21.012478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6fe9155b-3185-47d3-90fe-be3a76993848 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:21.077352 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6fe9155b-3185-47d3-90fe-be3a76993848 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:21.085066 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6fe9155b-3185-47d3-90fe-be3a76993848 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1191 microversion: 2.1 time: 0.085804 Jul 11 21:01:21.085551 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 211/426] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:20 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:21.339670 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8ad772fc-23a0-409d-85a4-0e8c79e943d4 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:21.340346 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8ad772fc-23a0-409d-85a4-0e8c79e943d4 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:21.347579 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8ad772fc-23a0-409d-85a4-0e8c79e943d4 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:21.348095 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8ad772fc-23a0-409d-85a4-0e8c79e943d4 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:21.349110 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8ad772fc-23a0-409d-85a4-0e8c79e943d4 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:21.349635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8ad772fc-23a0-409d-85a4-0e8c79e943d4 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:21.499724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8ad772fc-23a0-409d-85a4-0e8c79e943d4 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:21.510549 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8ad772fc-23a0-409d-85a4-0e8c79e943d4 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1511 microversion: 2.1 time: 0.176456 Jul 11 21:01:21.511117 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 216/427] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:21 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:22.103903 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7a3e8154-7570-473b-8d73-b527ae9a62e6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:22.104636 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7a3e8154-7570-473b-8d73-b527ae9a62e6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:22.111696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a3e8154-7570-473b-8d73-b527ae9a62e6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:22.112261 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a3e8154-7570-473b-8d73-b527ae9a62e6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:22.113112 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a3e8154-7570-473b-8d73-b527ae9a62e6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:22.113609 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a3e8154-7570-473b-8d73-b527ae9a62e6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:22.126004 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0cf82cc0-336b-45e2-bcbc-ef0d0db61d1b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:22.126752 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0cf82cc0-336b-45e2-bcbc-ef0d0db61d1b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:22.133105 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0cf82cc0-336b-45e2-bcbc-ef0d0db61d1b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:22.133521 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0cf82cc0-336b-45e2-bcbc-ef0d0db61d1b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:22.134636 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0cf82cc0-336b-45e2-bcbc-ef0d0db61d1b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:22.135362 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0cf82cc0-336b-45e2-bcbc-ef0d0db61d1b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:22.159632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0cf82cc0-336b-45e2-bcbc-ef0d0db61d1b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/ips" status: 200 len: 152 microversion: 2.20 time: 0.037655 Jul 11 21:01:22.160101 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 217/428] 10.222.0.20 () {60 vars in 1288 bytes} [Mon Jul 11 21:01:22 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 21:01:22.246431 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7a3e8154-7570-473b-8d73-b527ae9a62e6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:22.254422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7a3e8154-7570-473b-8d73-b527ae9a62e6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1209 microversion: 2.1 time: 0.155134 Jul 11 21:01:22.255556 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 212/429] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:22 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1209 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:22.530213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0f692a8a-340e-4831-8ac2-f62c07c3405c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:22.530931 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0f692a8a-340e-4831-8ac2-f62c07c3405c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:22.535241 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-5d24acf5-0276-4c42-8e36-78c2a4127c6f req-38e58c05-71ff-4246-8a24-ae05d6467a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c351b1b3-411c-4042-b8a7-a8370a2f161c", "name": "network-vif-deleted", "tag": "f16e4c4e-a386-47de-93b8-b66a6d98055c"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:22.537608 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0f692a8a-340e-4831-8ac2-f62c07c3405c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:22.538063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0f692a8a-340e-4831-8ac2-f62c07c3405c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:22.538995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0f692a8a-340e-4831-8ac2-f62c07c3405c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:22.539273 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0f692a8a-340e-4831-8ac2-f62c07c3405c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:22.547638 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-5d24acf5-0276-4c42-8e36-78c2a4127c6f req-38e58c05-71ff-4246-8a24-ae05d6467a1e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:22.557915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-5d24acf5-0276-4c42-8e36-78c2a4127c6f req-38e58c05-71ff-4246-8a24-ae05d6467a1e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:22.573709 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-5d24acf5-0276-4c42-8e36-78c2a4127c6f req-38e58c05-71ff-4246-8a24-ae05d6467a1e service nova] Creating event network-vif-deleted:f16e4c4e-a386-47de-93b8-b66a6d98055c for instance c351b1b3-411c-4042-b8a7-a8370a2f161c on hv-cinder-84902 Jul 11 21:01:22.579000 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-5d24acf5-0276-4c42-8e36-78c2a4127c6f req-38e58c05-71ff-4246-8a24-ae05d6467a1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051453 Jul 11 21:01:22.579581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 213/430] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:01:22.615652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0f692a8a-340e-4831-8ac2-f62c07c3405c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:22.630031 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0f692a8a-340e-4831-8ac2-f62c07c3405c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 200 len: 1469 microversion: 2.1 time: 0.106852 Jul 11 21:01:22.630931 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 218/431] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:22 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 1469 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:23.041361 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c3abc731-b129-4df0-b965-79602aa7372b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36fb3156-5304-4a76-a8f6-dd6dd4d5d2f9"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:23.042513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c3abc731-b129-4df0-b965-79602aa7372b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:23.049644 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c3abc731-b129-4df0-b965-79602aa7372b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:23.050082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c3abc731-b129-4df0-b965-79602aa7372b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:23.051023 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c3abc731-b129-4df0-b965-79602aa7372b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:23.051616 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c3abc731-b129-4df0-b965-79602aa7372b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:23.272605 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b4a22cde-6634-4985-9c1f-470b2324d4f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:23.273855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b4a22cde-6634-4985-9c1f-470b2324d4f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:23.281631 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4a22cde-6634-4985-9c1f-470b2324d4f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:23.282256 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4a22cde-6634-4985-9c1f-470b2324d4f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:23.283462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4a22cde-6634-4985-9c1f-470b2324d4f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:23.284053 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4a22cde-6634-4985-9c1f-470b2324d4f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:23.429721 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c3abc731-b129-4df0-b965-79602aa7372b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392496 Jul 11 21:01:23.430886 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 214/432] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:01:23 2022] POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:01:23.456280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b4a22cde-6634-4985-9c1f-470b2324d4f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:23.466396 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b4a22cde-6634-4985-9c1f-470b2324d4f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1277 microversion: 2.1 time: 0.198310 Jul 11 21:01:23.467558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 219/433] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:23 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:23.649664 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:23.650460 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: c351b1b3-411c-4042-b8a7-a8370a2f161c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:23.657360 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:23.657805 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:23.658570 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:23.659001 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:23.674070 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] HTTP exception thrown: Instance c351b1b3-411c-4042-b8a7-a8370a2f161c could not be found. Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Request method failure captured: Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c HTTP/1.1 Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI80cL_-agWRf93iFDkt5OlckFrFEyKk8psSe--J6kF63ovpWPN7MWKEbSYZ3FbXV2J7eJsz_nBw8WhyXfHbXcKz7tdS-XJGgkxhBkNWR9bMJWIFe3H-5L-WRsWFEYd_hSJzt1_Blw37FOBbuzkO7ZxyOirWRXnxBOE2B6af6GMWXtM Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 36d40e24cac74460bbbed4dffce9a4da Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1834755868 Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:01:23.676072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36d40e24cac74460bbbed4dffce9a4da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36d40e24cac74460bbbed4dffce9a4da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36d40e24cac74460bbbed4dffce9a4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36d40e24cac74460bbbed4dffce9a4da", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-VolumesSnapshotTestJSON-1834755868 Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 36d40e24cac74460bbbed4dffce9a4da Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1834755868 Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-VolumesSnapshotTestJSON-1834755868-project Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 63ec8ab7842a443c922a39f5ffcfd51a Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-VolumesSnapshotTestJSON-1834755868-project Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance c351b1b3-411c-4042-b8a7-a8370a2f161c could not be found. Jul 11 21:01:23.677630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': 'c351b1b3-411c-4042-b8a7-a8370a2f161c'} Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c351b1b3-411c-4042-b8a7-a8370a2f161c could not be found. Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:01:23.678916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c351b1b3-411c-4042-b8a7-a8370a2f161c could not be found. Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c351b1b3-411c-4042-b8a7-a8370a2f161c could not be found. Jul 11 21:01:23.680238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:01:23.682179 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Returning 404 to user: Instance c351b1b3-411c-4042-b8a7-a8370a2f161c could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:01:23.682179 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6e4484d6-55c5-4bc5-a6d3-8c89a98546d5 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c" status: 404 len: 111 microversion: 2.1 time: 0.033052 Jul 11 21:01:23.683518 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 215/434] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:23 2022] GET /compute/v2.1/servers/c351b1b3-411c-4042-b8a7-a8370a2f161c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:01:24.487184 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ab458a51-19c4-4a8b-97f7-b48fd66ab10f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:24.488207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ab458a51-19c4-4a8b-97f7-b48fd66ab10f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:24.496444 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ab458a51-19c4-4a8b-97f7-b48fd66ab10f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:24.496873 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ab458a51-19c4-4a8b-97f7-b48fd66ab10f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:24.497639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ab458a51-19c4-4a8b-97f7-b48fd66ab10f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:24.498079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ab458a51-19c4-4a8b-97f7-b48fd66ab10f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:24.592919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-3f383864-851d-4187-a229-7f9ba244b036 req-ffa701c1-8712-47c6-908a-d90e0d19ad39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab48eb9-c7dd-477d-9722-c03b4e165059", "tag": "4eb794cf-2acb-4971-9c22-8e3d115edb88"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:24.602354 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-3f383864-851d-4187-a229-7f9ba244b036 req-ffa701c1-8712-47c6-908a-d90e0d19ad39 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:24.602859 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-3f383864-851d-4187-a229-7f9ba244b036 req-ffa701c1-8712-47c6-908a-d90e0d19ad39 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:24.613993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-3f383864-851d-4187-a229-7f9ba244b036 req-ffa701c1-8712-47c6-908a-d90e0d19ad39 service nova] Creating event network-changed:4eb794cf-2acb-4971-9c22-8e3d115edb88 for instance aab48eb9-c7dd-477d-9722-c03b4e165059 on hv-cinder-84902 Jul 11 21:01:24.619264 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-3f383864-851d-4187-a229-7f9ba244b036 req-ffa701c1-8712-47c6-908a-d90e0d19ad39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029942 Jul 11 21:01:24.619769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 216/435] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:01:24.637600 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ab458a51-19c4-4a8b-97f7-b48fd66ab10f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:24.646500 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ab458a51-19c4-4a8b-97f7-b48fd66ab10f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.165950 Jul 11 21:01:24.647085 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 220/436] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:24 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:25.072551 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f241bf19-2718-4346-8f30-16a8398eaafa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:25.073343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f241bf19-2718-4346-8f30-16a8398eaafa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:25.083736 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f241bf19-2718-4346-8f30-16a8398eaafa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:25.084429 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f241bf19-2718-4346-8f30-16a8398eaafa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:25.085485 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f241bf19-2718-4346-8f30-16a8398eaafa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:25.085912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f241bf19-2718-4346-8f30-16a8398eaafa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:25.108289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-f241bf19-2718-4346-8f30-16a8398eaafa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lazy-loading 'flavor' on Instance uuid 1536f24e-dc7b-4eaf-9b73-32205dbca872 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:01:25.439175 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f241bf19-2718-4346-8f30-16a8398eaafa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/action" status: 202 len: 0 microversion: 2.20 time: 0.374045 Jul 11 21:01:25.439788 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 217/437] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jul 11 21:01:25 2022] POST /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:01:25.448790 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:25.449457 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:25.455621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:25.456070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:25.456932 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:25.457366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:25.599496 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:25.611995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:25.611995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:25.611995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3ea01cc4-9833-4a2d-a71a-00c1d2d9e893 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.166729 Jul 11 21:01:25.612339 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 221/438] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:25 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:25.665196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d116fc6a-86b5-46ef-93bd-5182da2bb42d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:25.665892 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d116fc6a-86b5-46ef-93bd-5182da2bb42d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:25.672721 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d116fc6a-86b5-46ef-93bd-5182da2bb42d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:25.673166 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d116fc6a-86b5-46ef-93bd-5182da2bb42d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:25.673936 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d116fc6a-86b5-46ef-93bd-5182da2bb42d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:25.674369 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d116fc6a-86b5-46ef-93bd-5182da2bb42d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:25.823682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d116fc6a-86b5-46ef-93bd-5182da2bb42d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:25.831524 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d116fc6a-86b5-46ef-93bd-5182da2bb42d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.171169 Jul 11 21:01:25.832081 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 218/439] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:25 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:26.635961 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:26.637106 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:26.646893 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:26.647630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:26.648958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:26.649556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:26.798683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:26.808181 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:26.810096 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:26.811768 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7dda304c-5826-49a5-9102-db3557f5c825 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.183393 Jul 11 21:01:26.812590 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 222/440] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:26 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:26.847809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9f9020bf-9db5-4bea-80f6-ccbc513e4b89 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:26.848439 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9f9020bf-9db5-4bea-80f6-ccbc513e4b89 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:26.855381 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9f9020bf-9db5-4bea-80f6-ccbc513e4b89 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:26.855824 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9f9020bf-9db5-4bea-80f6-ccbc513e4b89 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:26.856619 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9f9020bf-9db5-4bea-80f6-ccbc513e4b89 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:26.857048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9f9020bf-9db5-4bea-80f6-ccbc513e4b89 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:27.000317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9f9020bf-9db5-4bea-80f6-ccbc513e4b89 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:27.007950 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9f9020bf-9db5-4bea-80f6-ccbc513e4b89 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.164020 Jul 11 21:01:27.008812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 219/441] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:26 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:27.833428 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:27.834191 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:27.843884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:27.844663 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:27.845884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:27.846518 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:27.978798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:27.987198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:27.988749 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:27.989907 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7f3d346f-eb18-4dd8-93b9-d9cf4dce36c9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.161827 Jul 11 21:01:27.990473 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 223/442] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:27 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:28.025540 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ad455133-e789-4edf-ae04-08665d1776ba tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:28.026146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ad455133-e789-4edf-ae04-08665d1776ba tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:28.032904 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad455133-e789-4edf-ae04-08665d1776ba tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:28.033350 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad455133-e789-4edf-ae04-08665d1776ba tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:28.034107 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad455133-e789-4edf-ae04-08665d1776ba tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:28.034538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad455133-e789-4edf-ae04-08665d1776ba tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:28.180340 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ad455133-e789-4edf-ae04-08665d1776ba tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:28.190702 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ad455133-e789-4edf-ae04-08665d1776ba tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.169013 Jul 11 21:01:28.191460 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 220/443] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:28 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:29.009193 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:29.010009 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:29.016490 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:29.016965 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:29.017747 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:29.018176 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:29.163608 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:29.174903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:29.176559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:29.178004 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a357e7a5-3d6f-420c-9879-49cb7ec14346 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.173184 Jul 11 21:01:29.178989 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 224/444] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:29 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 21:01:29.207806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-368aac17-1d87-4f8f-8edc-522612b61eb2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:29.208579 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-368aac17-1d87-4f8f-8edc-522612b61eb2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:29.215571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-368aac17-1d87-4f8f-8edc-522612b61eb2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:29.216016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-368aac17-1d87-4f8f-8edc-522612b61eb2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:29.216815 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-368aac17-1d87-4f8f-8edc-522612b61eb2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:29.217247 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-368aac17-1d87-4f8f-8edc-522612b61eb2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:29.362021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-368aac17-1d87-4f8f-8edc-522612b61eb2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:29.369765 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-368aac17-1d87-4f8f-8edc-522612b61eb2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.165797 Jul 11 21:01:29.370330 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 221/445] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:29 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:30.197236 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:30.197933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:30.200047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:30.205863 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:30.206376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:30.207249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:30.207666 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:30.348065 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:30.361763 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:30.363387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:30.365199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3b9c474f-a934-4cf1-be2b-07b9a1d55539 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.172045 Jul 11 21:01:30.366067 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 225/446] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:30 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:30.387480 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f7bff9f1-ae23-455a-90de-8e3b23061c7d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:30.387925 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f7bff9f1-ae23-455a-90de-8e3b23061c7d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:30.393055 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:30.393716 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:30.396733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f7bff9f1-ae23-455a-90de-8e3b23061c7d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:30.397483 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f7bff9f1-ae23-455a-90de-8e3b23061c7d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:30.398461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f7bff9f1-ae23-455a-90de-8e3b23061c7d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:30.398912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f7bff9f1-ae23-455a-90de-8e3b23061c7d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:30.404415 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:30.707203 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f7bff9f1-ae23-455a-90de-8e3b23061c7d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:30.715437 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f7bff9f1-ae23-455a-90de-8e3b23061c7d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.332552 Jul 11 21:01:30.716013 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 222/447] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:30 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:31.384467 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:31.385197 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:31.391682 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:31.392141 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:31.392917 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:31.393348 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:31.522066 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:31.530460 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:31.531951 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:31.533141 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fe96e331-5f59-432a-a26b-798f96e61eee tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.152755 Jul 11 21:01:31.533742 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 226/448] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:31 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:31.736769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-30cd828b-50ec-4e81-8d22-7de10639ce99 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:31.737829 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-30cd828b-50ec-4e81-8d22-7de10639ce99 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:31.747432 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30cd828b-50ec-4e81-8d22-7de10639ce99 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:31.747818 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30cd828b-50ec-4e81-8d22-7de10639ce99 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:31.748630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30cd828b-50ec-4e81-8d22-7de10639ce99 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:31.749063 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-30cd828b-50ec-4e81-8d22-7de10639ce99 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:31.894521 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-30cd828b-50ec-4e81-8d22-7de10639ce99 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:31.902770 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-30cd828b-50ec-4e81-8d22-7de10639ce99 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.172589 Jul 11 21:01:31.903349 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 223/449] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:31 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:32.550907 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:32.551529 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:32.558387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:32.558830 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:32.559580 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:32.560012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:32.706238 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:32.714916 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:32.716454 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:32.717610 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1b60927d-11e3-4fde-846e-c56e7e451005 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.170623 Jul 11 21:01:32.718157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 227/450] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:32 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:32.923340 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e7232816-0d55-4532-a92e-bfc735cf325d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:32.924374 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e7232816-0d55-4532-a92e-bfc735cf325d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:32.936163 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e7232816-0d55-4532-a92e-bfc735cf325d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:32.936915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e7232816-0d55-4532-a92e-bfc735cf325d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:32.938136 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e7232816-0d55-4532-a92e-bfc735cf325d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:32.938872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e7232816-0d55-4532-a92e-bfc735cf325d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:33.089020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e7232816-0d55-4532-a92e-bfc735cf325d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:33.096960 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e7232816-0d55-4532-a92e-bfc735cf325d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.180231 Jul 11 21:01:33.097528 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 224/451] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:32 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:33.737694 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:33.738294 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:33.744833 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:33.745276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:33.746026 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:33.746453 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:33.889871 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:33.897885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:33.899360 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:33.900823 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-53eb3a84-1660-4aa6-85b0-9cef854c4e8e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.167102 Jul 11 21:01:33.901396 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 228/452] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:33 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:34.113986 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5916ff2b-522a-4736-9c3c-7d5f4e724739 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:34.114599 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5916ff2b-522a-4736-9c3c-7d5f4e724739 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:34.121678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5916ff2b-522a-4736-9c3c-7d5f4e724739 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:34.122149 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5916ff2b-522a-4736-9c3c-7d5f4e724739 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:34.122913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5916ff2b-522a-4736-9c3c-7d5f4e724739 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:34.123342 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5916ff2b-522a-4736-9c3c-7d5f4e724739 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:34.258629 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5916ff2b-522a-4736-9c3c-7d5f4e724739 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:34.266652 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5916ff2b-522a-4736-9c3c-7d5f4e724739 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.156574 Jul 11 21:01:34.267226 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 225/453] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:34 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:34.920423 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:34.921116 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:34.927644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:34.928599 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:34.929365 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:34.929801 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:34.950252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:35.072324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:35.080696 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:35.082182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:35.083323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a8029d1f-9711-4d7e-918f-3eea448f89f8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.167994 Jul 11 21:01:35.083914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 229/454] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:34 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:35.284009 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4b6842a0-6861-40a9-bfe0-1d03bbf60ba7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:35.284642 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4b6842a0-6861-40a9-bfe0-1d03bbf60ba7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:35.291621 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b6842a0-6861-40a9-bfe0-1d03bbf60ba7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:35.292042 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b6842a0-6861-40a9-bfe0-1d03bbf60ba7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:35.292835 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b6842a0-6861-40a9-bfe0-1d03bbf60ba7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:35.293259 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b6842a0-6861-40a9-bfe0-1d03bbf60ba7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:35.435164 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4b6842a0-6861-40a9-bfe0-1d03bbf60ba7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:35.444445 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4b6842a0-6861-40a9-bfe0-1d03bbf60ba7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.164128 Jul 11 21:01:35.445293 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 226/455] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:35 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:35.734892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-48303768", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "networks": [{"uuid": "9f72b8bb-74fb-4b92-94e7-3d4997851570"}]}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:35.786732 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.network.neutron [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] validate_networks() for [('9f72b8bb-74fb-4b92-94e7-3d4997851570', None, None, None, None, None)] {{(pid=118013) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:01:36.102769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:36.103500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:36.110098 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:36.110540 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:36.111304 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:36.111786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:36.269273 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:36.281540 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:36.283159 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:36.284552 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c9b5f822-3659-49fe-9242-3e88b338362e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.186349 Jul 11 21:01:36.285394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 227/456] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:36 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 21:01:36.423945 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Flavor limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:01:36.424502 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Image limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:01:36.424846 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Flavor pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:01:36.425245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Image pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:01:36.425669 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:01:36.438218 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:36.438565 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:36.439348 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:36.439776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:36.457769 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Getting quotas for project 36d40e24cac74460bbbed4dffce9a4da. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:01:36.463440 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Getting quotas for user 63ec8ab7842a443c922a39f5ffcfd51a and project 36d40e24cac74460bbbed4dffce9a4da. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:01:36.466983 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d09152b5-fa55-4e22-b951-ed8bc1a6d58b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:36.467650 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d09152b5-fa55-4e22-b951-ed8bc1a6d58b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:36.473908 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d09152b5-fa55-4e22-b951-ed8bc1a6d58b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:36.474351 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d09152b5-fa55-4e22-b951-ed8bc1a6d58b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:36.475100 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d09152b5-fa55-4e22-b951-ed8bc1a6d58b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:36.475646 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d09152b5-fa55-4e22-b951-ed8bc1a6d58b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:36.476245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Going to run 1 instances... {{(pid=118013) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:01:36.478799 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118013) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:01:36.529488 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-de86afda-d4aa-4de1-9f33-9fc01e211385 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798546 Jul 11 21:01:36.532282 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 230/457] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:01:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:01:36.542738 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e829afc2-c2c5-49de-b44a-03ccc5dd527e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:36.543513 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e829afc2-c2c5-49de-b44a-03ccc5dd527e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:36.602279 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e829afc2-c2c5-49de-b44a-03ccc5dd527e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:36.610910 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e829afc2-c2c5-49de-b44a-03ccc5dd527e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1217 microversion: 2.1 time: 0.074579 Jul 11 21:01:36.611567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 231/458] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:36 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:36.626122 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d09152b5-fa55-4e22-b951-ed8bc1a6d58b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:36.633971 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d09152b5-fa55-4e22-b951-ed8bc1a6d58b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.171177 Jul 11 21:01:36.634760 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 228/459] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:36 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:37.302825 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:37.303813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:37.310136 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:37.310577 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:37.311325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:37.311748 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:37.441883 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:37.451021 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:37.452545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:37.453708 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-57165be7-ba22-4441-bf51-15e482221fca tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.154800 Jul 11 21:01:37.454283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 232/460] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:37 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:37.628540 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6c095270-b3a5-4e34-833f-bc7e88bf4832 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:37.629142 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6c095270-b3a5-4e34-833f-bc7e88bf4832 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:37.636461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c095270-b3a5-4e34-833f-bc7e88bf4832 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:37.636901 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c095270-b3a5-4e34-833f-bc7e88bf4832 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:37.637653 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c095270-b3a5-4e34-833f-bc7e88bf4832 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:37.638066 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c095270-b3a5-4e34-833f-bc7e88bf4832 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:37.651113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f21f85fe-7cd8-483a-8e72-1385b51ecd1d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:37.651726 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f21f85fe-7cd8-483a-8e72-1385b51ecd1d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:37.659227 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f21f85fe-7cd8-483a-8e72-1385b51ecd1d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:37.659791 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f21f85fe-7cd8-483a-8e72-1385b51ecd1d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:37.660584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f21f85fe-7cd8-483a-8e72-1385b51ecd1d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:37.661009 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f21f85fe-7cd8-483a-8e72-1385b51ecd1d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:37.704198 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6c095270-b3a5-4e34-833f-bc7e88bf4832 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:37.711739 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6c095270-b3a5-4e34-833f-bc7e88bf4832 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1221 microversion: 2.1 time: 0.087102 Jul 11 21:01:37.712357 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 229/461] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:37 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:37.799746 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f21f85fe-7cd8-483a-8e72-1385b51ecd1d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:37.808506 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f21f85fe-7cd8-483a-8e72-1385b51ecd1d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.161504 Jul 11 21:01:37.809079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 233/462] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:37 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:38.472575 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:38.473180 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:38.479968 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:38.480578 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:38.481346 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:38.481780 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:38.643925 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:38.652316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:38.653810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:38.654952 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-adf3f3e0-9fc1-4bb3-96eb-da7eebef7202 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.186449 Jul 11 21:01:38.655501 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 230/463] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:38 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:38.729456 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3ba77186-849b-4549-a128-ed1fc3a054b8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:38.730046 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3ba77186-849b-4549-a128-ed1fc3a054b8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:38.736306 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ba77186-849b-4549-a128-ed1fc3a054b8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:38.736758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ba77186-849b-4549-a128-ed1fc3a054b8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:38.737528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ba77186-849b-4549-a128-ed1fc3a054b8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:38.737969 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ba77186-849b-4549-a128-ed1fc3a054b8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:38.804611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3ba77186-849b-4549-a128-ed1fc3a054b8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:38.812809 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3ba77186-849b-4549-a128-ed1fc3a054b8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1269 microversion: 2.1 time: 0.087685 Jul 11 21:01:38.813388 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 234/464] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:38 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:38.825975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2c5cf987-32f9-4f6e-afa8-f51f2100a15e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:38.828757 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2c5cf987-32f9-4f6e-afa8-f51f2100a15e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:38.835120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2c5cf987-32f9-4f6e-afa8-f51f2100a15e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:38.835565 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2c5cf987-32f9-4f6e-afa8-f51f2100a15e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:38.836450 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2c5cf987-32f9-4f6e-afa8-f51f2100a15e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:38.836938 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2c5cf987-32f9-4f6e-afa8-f51f2100a15e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:38.973771 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2c5cf987-32f9-4f6e-afa8-f51f2100a15e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:38.982892 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2c5cf987-32f9-4f6e-afa8-f51f2100a15e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.161200 Jul 11 21:01:38.983513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 231/465] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:38 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:39.469235 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e1f7e53f-cc0c-409d-ac97-4f6536550fdd tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:39.475317 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e1f7e53f-cc0c-409d-ac97-4f6536550fdd tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:39.475783 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e1f7e53f-cc0c-409d-ac97-4f6536550fdd tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:39.535322 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e1f7e53f-cc0c-409d-ac97-4f6536550fdd tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Going to try to stop instance {{(pid=118013) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 11 21:01:39.578895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e1f7e53f-cc0c-409d-ac97-4f6536550fdd tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/action" status: 202 len: 0 microversion: 2.1 time: 0.113370 Jul 11 21:01:39.579825 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 235/466] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:01:39 2022] POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:01:39.588370 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-132a766a-9693-4a44-ab2a-4a64cc330961 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:39.589234 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-132a766a-9693-4a44-ab2a-4a64cc330961 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:39.595699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-132a766a-9693-4a44-ab2a-4a64cc330961 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:39.596342 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-132a766a-9693-4a44-ab2a-4a64cc330961 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:39.597299 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-132a766a-9693-4a44-ab2a-4a64cc330961 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:39.597728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-132a766a-9693-4a44-ab2a-4a64cc330961 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:39.674296 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:39.674920 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:39.681974 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:39.682446 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:39.683216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:39.683646 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:39.775902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-132a766a-9693-4a44-ab2a-4a64cc330961 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:39.785499 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-132a766a-9693-4a44-ab2a-4a64cc330961 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.201330 Jul 11 21:01:39.786531 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 232/467] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:39 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:39.822895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:39.832025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:39.840689 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b3156502-a3d5-4403-81e0-5ffc0e1e2422 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:39.840972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:39.842796 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-93f784d6-0f49-4625-be22-6c169ad94ae7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.172742 Jul 11 21:01:39.843019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 236/468] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:39 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 21:01:39.843591 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-b3156502-a3d5-4403-81e0-5ffc0e1e2422 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:39.850777 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b3156502-a3d5-4403-81e0-5ffc0e1e2422 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:39.851324 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b3156502-a3d5-4403-81e0-5ffc0e1e2422 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:39.852172 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b3156502-a3d5-4403-81e0-5ffc0e1e2422 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:39.852666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b3156502-a3d5-4403-81e0-5ffc0e1e2422 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:39.999113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f80b0f44-f299-46e7-b41c-de63b2b98d3d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:39.999814 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f80b0f44-f299-46e7-b41c-de63b2b98d3d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:40.006014 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f80b0f44-f299-46e7-b41c-de63b2b98d3d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:40.006454 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f80b0f44-f299-46e7-b41c-de63b2b98d3d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:40.007213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f80b0f44-f299-46e7-b41c-de63b2b98d3d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:40.007636 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f80b0f44-f299-46e7-b41c-de63b2b98d3d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:40.045980 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-b3156502-a3d5-4403-81e0-5ffc0e1e2422 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:40.057164 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b3156502-a3d5-4403-81e0-5ffc0e1e2422 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.223602 Jul 11 21:01:40.057742 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 233/469] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:39 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:40.147167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f80b0f44-f299-46e7-b41c-de63b2b98d3d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:40.165399 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f80b0f44-f299-46e7-b41c-de63b2b98d3d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.169509 Jul 11 21:01:40.175009 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 237/470] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:39 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:40.634678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-36e42c3e-e3e1-4d3d-9e73-835e70958545 req-b86fabf3-f8b5-4e48-a2c9-a5b45997e60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd574c88-de3e-4736-a11a-23b4f2fe13ee", "tag": "b4c152ef-9a1e-409b-91a3-2e1fc3836703"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:40.644348 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-36e42c3e-e3e1-4d3d-9e73-835e70958545 req-b86fabf3-f8b5-4e48-a2c9-a5b45997e60a service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:40.644879 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-36e42c3e-e3e1-4d3d-9e73-835e70958545 req-b86fabf3-f8b5-4e48-a2c9-a5b45997e60a service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:40.657233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-36e42c3e-e3e1-4d3d-9e73-835e70958545 req-b86fabf3-f8b5-4e48-a2c9-a5b45997e60a service nova] Creating event network-changed:b4c152ef-9a1e-409b-91a3-2e1fc3836703 for instance fd574c88-de3e-4736-a11a-23b4f2fe13ee on hv-cinder-84902 Jul 11 21:01:40.662762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-36e42c3e-e3e1-4d3d-9e73-835e70958545 req-b86fabf3-f8b5-4e48-a2c9-a5b45997e60a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032125 Jul 11 21:01:40.663380 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 234/471] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:01:40.803343 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3501bb27-cd73-42ef-9346-c15b9b2ef732 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:40.803951 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3501bb27-cd73-42ef-9346-c15b9b2ef732 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:40.810717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3501bb27-cd73-42ef-9346-c15b9b2ef732 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:40.811165 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3501bb27-cd73-42ef-9346-c15b9b2ef732 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:40.811927 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3501bb27-cd73-42ef-9346-c15b9b2ef732 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:40.812399 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3501bb27-cd73-42ef-9346-c15b9b2ef732 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:40.861832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:40.862522 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:40.869183 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:40.869841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:40.870785 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:40.871207 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:40.955666 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3501bb27-cd73-42ef-9346-c15b9b2ef732 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:40.966595 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3501bb27-cd73-42ef-9346-c15b9b2ef732 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.167443 Jul 11 21:01:40.967163 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 238/472] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:40 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:41.076727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f2d4c51d-2fc9-4015-afca-4a7ac23982dd tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:41.077255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f2d4c51d-2fc9-4015-afca-4a7ac23982dd tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:41.083753 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f2d4c51d-2fc9-4015-afca-4a7ac23982dd tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:41.084232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f2d4c51d-2fc9-4015-afca-4a7ac23982dd tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:41.085242 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f2d4c51d-2fc9-4015-afca-4a7ac23982dd tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:41.085676 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f2d4c51d-2fc9-4015-afca-4a7ac23982dd tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:41.228660 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f2d4c51d-2fc9-4015-afca-4a7ac23982dd tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:41.236386 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f2d4c51d-2fc9-4015-afca-4a7ac23982dd tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.164253 Jul 11 21:01:41.237230 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 239/473] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:41 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:41.248519 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-938a82ca-833a-4222-958a-58e789b484aa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:41.249354 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-938a82ca-833a-4222-958a-58e789b484aa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:41.255556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-938a82ca-833a-4222-958a-58e789b484aa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:41.256039 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-938a82ca-833a-4222-958a-58e789b484aa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:41.256950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-938a82ca-833a-4222-958a-58e789b484aa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:41.257376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-938a82ca-833a-4222-958a-58e789b484aa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:41.352322 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:41.363970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:41.365513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:41.366719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7738fdba-a5a0-41e3-ae3e-5ea025650b64 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.509548 Jul 11 21:01:41.377033 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 235/474] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:40 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:41.409642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-938a82ca-833a-4222-958a-58e789b484aa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:41.417757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-938a82ca-833a-4222-958a-58e789b484aa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.173336 Jul 11 21:01:41.418362 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 240/475] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:41 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:41.997064 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bf055617-e75a-4927-bd77-4842e086bb13 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:41.997986 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bf055617-e75a-4927-bd77-4842e086bb13 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:42.009067 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bf055617-e75a-4927-bd77-4842e086bb13 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:42.009958 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bf055617-e75a-4927-bd77-4842e086bb13 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:42.010847 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bf055617-e75a-4927-bd77-4842e086bb13 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:42.011278 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bf055617-e75a-4927-bd77-4842e086bb13 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:42.157764 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bf055617-e75a-4927-bd77-4842e086bb13 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:42.166299 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bf055617-e75a-4927-bd77-4842e086bb13 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.176279 Jul 11 21:01:42.166982 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 236/476] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:41 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:42.258072 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-beb6274a-9838-4abb-8330-bd37ef6d5548 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:42.258972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-beb6274a-9838-4abb-8330-bd37ef6d5548 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:42.269643 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-beb6274a-9838-4abb-8330-bd37ef6d5548 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:42.270389 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-beb6274a-9838-4abb-8330-bd37ef6d5548 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:42.271707 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-beb6274a-9838-4abb-8330-bd37ef6d5548 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:42.272517 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-beb6274a-9838-4abb-8330-bd37ef6d5548 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:42.385964 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:42.386836 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:42.393910 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:42.394397 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:42.395249 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:42.395680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:42.410292 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-beb6274a-9838-4abb-8330-bd37ef6d5548 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:42.419408 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-beb6274a-9838-4abb-8330-bd37ef6d5548 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.167943 Jul 11 21:01:42.419995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 241/477] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:42 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:42.435036 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c8ab2a31-9638-4254-ac82-b03fbee5f458 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:42.435636 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c8ab2a31-9638-4254-ac82-b03fbee5f458 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:42.442187 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c8ab2a31-9638-4254-ac82-b03fbee5f458 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:42.442629 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c8ab2a31-9638-4254-ac82-b03fbee5f458 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:42.443372 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c8ab2a31-9638-4254-ac82-b03fbee5f458 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:42.443816 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c8ab2a31-9638-4254-ac82-b03fbee5f458 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:42.540689 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:42.548790 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:42.550284 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:42.551441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bbe885ac-76ca-460c-87be-4aa88f31042c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.169899 Jul 11 21:01:42.552008 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 237/478] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:42 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:42.583926 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c8ab2a31-9638-4254-ac82-b03fbee5f458 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:42.591475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c8ab2a31-9638-4254-ac82-b03fbee5f458 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.160265 Jul 11 21:01:42.592040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 242/479] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:42 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:42.971610 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-e8c20f77-333a-4ca1-aabb-421efb374502 req-b6bc8f26-ef24-4de5-904a-11c0f24e7b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab48eb9-c7dd-477d-9722-c03b4e165059", "name": "network-vif-plugged", "status": "completed", "tag": "4eb794cf-2acb-4971-9c22-8e3d115edb88"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:42.980319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-e8c20f77-333a-4ca1-aabb-421efb374502 req-b6bc8f26-ef24-4de5-904a-11c0f24e7b43 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:42.980805 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-e8c20f77-333a-4ca1-aabb-421efb374502 req-b6bc8f26-ef24-4de5-904a-11c0f24e7b43 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:42.991997 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-e8c20f77-333a-4ca1-aabb-421efb374502 req-b6bc8f26-ef24-4de5-904a-11c0f24e7b43 service nova] Creating event network-vif-plugged:4eb794cf-2acb-4971-9c22-8e3d115edb88 for instance aab48eb9-c7dd-477d-9722-c03b4e165059 on hv-cinder-84902 Jul 11 21:01:42.997173 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-e8c20f77-333a-4ca1-aabb-421efb374502 req-b6bc8f26-ef24-4de5-904a-11c0f24e7b43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029365 Jul 11 21:01:42.997920 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 238/480] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:01:43.188997 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-19a96045-a3e9-4e6c-99ad-dcfde25b5de1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:43.189967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-19a96045-a3e9-4e6c-99ad-dcfde25b5de1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:43.199698 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-19a96045-a3e9-4e6c-99ad-dcfde25b5de1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:43.200162 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-19a96045-a3e9-4e6c-99ad-dcfde25b5de1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:43.200946 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-19a96045-a3e9-4e6c-99ad-dcfde25b5de1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:43.201373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-19a96045-a3e9-4e6c-99ad-dcfde25b5de1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:43.337905 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-19a96045-a3e9-4e6c-99ad-dcfde25b5de1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:43.347540 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-19a96045-a3e9-4e6c-99ad-dcfde25b5de1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.165111 Jul 11 21:01:43.348178 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 243/481] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:43 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:43.439273 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-239183ea-5f3d-4a59-8600-f2aefe81e393 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:43.440159 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-239183ea-5f3d-4a59-8600-f2aefe81e393 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:43.449933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-239183ea-5f3d-4a59-8600-f2aefe81e393 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:43.450378 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-239183ea-5f3d-4a59-8600-f2aefe81e393 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:43.451143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-239183ea-5f3d-4a59-8600-f2aefe81e393 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:43.451572 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-239183ea-5f3d-4a59-8600-f2aefe81e393 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:43.571750 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:43.572533 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:43.579882 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:43.580533 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:43.581693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:43.582167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:43.594789 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-239183ea-5f3d-4a59-8600-f2aefe81e393 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:43.602893 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-239183ea-5f3d-4a59-8600-f2aefe81e393 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.169396 Jul 11 21:01:43.604064 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 239/482] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:43 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:43.608917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d6896b82-9e5c-4a52-bc2f-d1b3e6561f8a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:43.609518 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d6896b82-9e5c-4a52-bc2f-d1b3e6561f8a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:43.615921 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d6896b82-9e5c-4a52-bc2f-d1b3e6561f8a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:43.616382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d6896b82-9e5c-4a52-bc2f-d1b3e6561f8a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:43.617373 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d6896b82-9e5c-4a52-bc2f-d1b3e6561f8a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:43.617874 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d6896b82-9e5c-4a52-bc2f-d1b3e6561f8a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:43.623931 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=100 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:43.725833 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:43.734781 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:43.736330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:43.737497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-33ce56d6-82be-4c5f-9251-3113b09464c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.170902 Jul 11 21:01:43.738198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 244/483] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:43 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:43.777922 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d6896b82-9e5c-4a52-bc2f-d1b3e6561f8a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:43.791689 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d6896b82-9e5c-4a52-bc2f-d1b3e6561f8a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.186531 Jul 11 21:01:43.792389 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 240/484] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:43 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:44.367153 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2d7cb5b7-a269-4def-a394-46bc00d96522 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:44.368250 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2d7cb5b7-a269-4def-a394-46bc00d96522 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:44.375852 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2d7cb5b7-a269-4def-a394-46bc00d96522 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:44.376349 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2d7cb5b7-a269-4def-a394-46bc00d96522 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:44.377103 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2d7cb5b7-a269-4def-a394-46bc00d96522 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:44.377530 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2d7cb5b7-a269-4def-a394-46bc00d96522 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:44.525707 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2d7cb5b7-a269-4def-a394-46bc00d96522 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:44.534338 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2d7cb5b7-a269-4def-a394-46bc00d96522 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.172374 Jul 11 21:01:44.534974 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 245/485] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:44 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:44.627370 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ef3e6222-6e22-4f02-b6b9-85b1c01dd85f tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:44.627913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ef3e6222-6e22-4f02-b6b9-85b1c01dd85f tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:44.634876 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef3e6222-6e22-4f02-b6b9-85b1c01dd85f tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:44.635347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef3e6222-6e22-4f02-b6b9-85b1c01dd85f tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:44.636376 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef3e6222-6e22-4f02-b6b9-85b1c01dd85f tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:44.636889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef3e6222-6e22-4f02-b6b9-85b1c01dd85f tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:44.756409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:44.757137 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:44.763899 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:44.764437 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:44.765261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:44.765754 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:44.779842 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ef3e6222-6e22-4f02-b6b9-85b1c01dd85f tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:44.788814 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ef3e6222-6e22-4f02-b6b9-85b1c01dd85f tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.166006 Jul 11 21:01:44.789413 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 241/486] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:44 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:44.811762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-86988147-a3eb-4fde-a3db-4f14b2c8060a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:44.812394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-86988147-a3eb-4fde-a3db-4f14b2c8060a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:44.818852 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-86988147-a3eb-4fde-a3db-4f14b2c8060a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:44.819270 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-86988147-a3eb-4fde-a3db-4f14b2c8060a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:44.820039 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-86988147-a3eb-4fde-a3db-4f14b2c8060a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:44.820502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-86988147-a3eb-4fde-a3db-4f14b2c8060a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:44.903419 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:44.906932 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:44.913178 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:44.914821 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:44.916207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f8677346-2dc1-4612-9704-23324faa39d3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.163796 Jul 11 21:01:44.917064 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 246/487] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:44 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:44.963319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-86988147-a3eb-4fde-a3db-4f14b2c8060a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:44.971306 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-86988147-a3eb-4fde-a3db-4f14b2c8060a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.163525 Jul 11 21:01:44.971880 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 242/488] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:44 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:45.557509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-055febf1-7263-43e2-916c-ee52dad0e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:45.559310 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-055febf1-7263-43e2-916c-ee52dad0e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:45.566648 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-055febf1-7263-43e2-916c-ee52dad0e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:45.567226 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-055febf1-7263-43e2-916c-ee52dad0e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:45.567998 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-055febf1-7263-43e2-916c-ee52dad0e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:45.568455 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-055febf1-7263-43e2-916c-ee52dad0e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:45.708446 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-055febf1-7263-43e2-916c-ee52dad0e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:45.718019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-055febf1-7263-43e2-916c-ee52dad0e168 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.165553 Jul 11 21:01:45.718887 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 247/489] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:45 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:45.810166 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-db856397-0d43-4e0b-9f0a-b05fc6b4728e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:45.810679 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-db856397-0d43-4e0b-9f0a-b05fc6b4728e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:45.817761 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-db856397-0d43-4e0b-9f0a-b05fc6b4728e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:45.818209 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-db856397-0d43-4e0b-9f0a-b05fc6b4728e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:45.818980 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-db856397-0d43-4e0b-9f0a-b05fc6b4728e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:45.819413 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-db856397-0d43-4e0b-9f0a-b05fc6b4728e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:45.935700 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:45.936341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:45.942658 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:45.943144 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:45.943910 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:45.944371 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:45.957605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-db856397-0d43-4e0b-9f0a-b05fc6b4728e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:45.965257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-db856397-0d43-4e0b-9f0a-b05fc6b4728e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.160532 Jul 11 21:01:45.965826 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 243/490] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:45 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:45.988097 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ee3d8e7e-8823-4c81-9303-d01c25fcc33a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:45.988762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ee3d8e7e-8823-4c81-9303-d01c25fcc33a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:45.994907 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee3d8e7e-8823-4c81-9303-d01c25fcc33a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:45.995344 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee3d8e7e-8823-4c81-9303-d01c25fcc33a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:45.996196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee3d8e7e-8823-4c81-9303-d01c25fcc33a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:45.996681 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee3d8e7e-8823-4c81-9303-d01c25fcc33a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:46.076625 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:46.084861 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:46.086345 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:46.087495 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-dd7b4dc6-2ea7-42c8-a8c0-bef98dafd830 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.156357 Jul 11 21:01:46.088064 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 248/491] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:45 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:46.128256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ee3d8e7e-8823-4c81-9303-d01c25fcc33a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:46.135911 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ee3d8e7e-8823-4c81-9303-d01c25fcc33a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.151601 Jul 11 21:01:46.136535 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 244/492] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:45 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:46.739914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3c082175-ba0b-455b-9ea8-9ef0486e621b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:46.741099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3c082175-ba0b-455b-9ea8-9ef0486e621b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:46.743944 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:46.745434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=8 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:46.746456 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:46.753336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3c082175-ba0b-455b-9ea8-9ef0486e621b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:46.753941 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3c082175-ba0b-455b-9ea8-9ef0486e621b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:46.754719 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3c082175-ba0b-455b-9ea8-9ef0486e621b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:46.755145 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3c082175-ba0b-455b-9ea8-9ef0486e621b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:46.901570 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3c082175-ba0b-455b-9ea8-9ef0486e621b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:46.910479 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3c082175-ba0b-455b-9ea8-9ef0486e621b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.177494 Jul 11 21:01:46.911180 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 249/493] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:46 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:46.982557 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9b889676-a1a6-4ca3-8c61-bb39626bff39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:46.983177 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9b889676-a1a6-4ca3-8c61-bb39626bff39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:46.990387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9b889676-a1a6-4ca3-8c61-bb39626bff39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:46.990832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9b889676-a1a6-4ca3-8c61-bb39626bff39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:46.991603 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9b889676-a1a6-4ca3-8c61-bb39626bff39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:46.992032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9b889676-a1a6-4ca3-8c61-bb39626bff39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:47.107050 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:47.107744 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:47.114139 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:47.114652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:47.115514 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:47.116411 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:47.127227 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9b889676-a1a6-4ca3-8c61-bb39626bff39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:47.136452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9b889676-a1a6-4ca3-8c61-bb39626bff39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.157690 Jul 11 21:01:47.144148 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 245/494] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:46 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:47.152680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4cc305ad-0f1f-4ecb-b858-6f0137e5b005 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:47.153395 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4cc305ad-0f1f-4ecb-b858-6f0137e5b005 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:47.156346 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:47.160462 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4cc305ad-0f1f-4ecb-b858-6f0137e5b005 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:47.160913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4cc305ad-0f1f-4ecb-b858-6f0137e5b005 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:47.161692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4cc305ad-0f1f-4ecb-b858-6f0137e5b005 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:47.162130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4cc305ad-0f1f-4ecb-b858-6f0137e5b005 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:47.254024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:47.262323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:47.263814 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:47.264997 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c46f1c91-7732-4123-9f52-f6cbe413d43d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.162695 Jul 11 21:01:47.265605 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 250/495] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:47 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 21:01:47.304766 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4cc305ad-0f1f-4ecb-b858-6f0137e5b005 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:47.312716 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4cc305ad-0f1f-4ecb-b858-6f0137e5b005 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.163963 Jul 11 21:01:47.313240 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 246/496] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:47 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:47.929927 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-33c5c0c3-2ec9-44b0-a68d-28fd5ce9cf21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:47.930728 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-33c5c0c3-2ec9-44b0-a68d-28fd5ce9cf21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:47.937922 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33c5c0c3-2ec9-44b0-a68d-28fd5ce9cf21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:47.938269 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33c5c0c3-2ec9-44b0-a68d-28fd5ce9cf21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:47.939352 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33c5c0c3-2ec9-44b0-a68d-28fd5ce9cf21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:47.939885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33c5c0c3-2ec9-44b0-a68d-28fd5ce9cf21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:48.093672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-33c5c0c3-2ec9-44b0-a68d-28fd5ce9cf21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:48.101665 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-33c5c0c3-2ec9-44b0-a68d-28fd5ce9cf21 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.176354 Jul 11 21:01:48.102208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 251/497] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:47 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:48.155541 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c3707700-a15c-4140-972b-dfdb17c4d89e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:48.156139 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c3707700-a15c-4140-972b-dfdb17c4d89e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:48.163148 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c3707700-a15c-4140-972b-dfdb17c4d89e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:48.163589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c3707700-a15c-4140-972b-dfdb17c4d89e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:48.164382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c3707700-a15c-4140-972b-dfdb17c4d89e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:48.164805 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c3707700-a15c-4140-972b-dfdb17c4d89e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:48.283310 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:48.284093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:48.290806 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:48.291293 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:48.292148 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:48.292637 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:48.305728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c3707700-a15c-4140-972b-dfdb17c4d89e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:48.313670 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c3707700-a15c-4140-972b-dfdb17c4d89e tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.163006 Jul 11 21:01:48.314251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 247/498] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:48 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:48.330246 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-60f1cc9e-6874-4529-bcff-5fd26354794b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:48.330857 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-60f1cc9e-6874-4529-bcff-5fd26354794b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:48.337633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-60f1cc9e-6874-4529-bcff-5fd26354794b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:48.338188 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-60f1cc9e-6874-4529-bcff-5fd26354794b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:48.339040 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-60f1cc9e-6874-4529-bcff-5fd26354794b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:48.339549 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-60f1cc9e-6874-4529-bcff-5fd26354794b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:48.427311 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:48.436156 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:48.437664 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:48.438818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-92367e6a-e533-4eb9-be36-379597f4dcfc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1746 microversion: 2.20 time: 0.159522 Jul 11 21:01:48.439388 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 252/499] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:48 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:48.480611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-60f1cc9e-6874-4529-bcff-5fd26354794b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:48.488325 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-60f1cc9e-6874-4529-bcff-5fd26354794b tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1265 microversion: 2.1 time: 0.162860 Jul 11 21:01:48.488908 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 248/500] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:48 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:01:49.122793 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9c87f67c-63fa-44fe-bdc1-5ac30d8d604c tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:49.123521 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9c87f67c-63fa-44fe-bdc1-5ac30d8d604c tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:49.130428 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9c87f67c-63fa-44fe-bdc1-5ac30d8d604c tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.130898 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9c87f67c-63fa-44fe-bdc1-5ac30d8d604c tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.131690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9c87f67c-63fa-44fe-bdc1-5ac30d8d604c tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.132131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9c87f67c-63fa-44fe-bdc1-5ac30d8d604c tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.266802 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9c87f67c-63fa-44fe-bdc1-5ac30d8d604c tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:49.274906 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9c87f67c-63fa-44fe-bdc1-5ac30d8d604c tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.158674 Jul 11 21:01:49.275508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 253/501] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:49 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:49.331562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-efab1fdf-8bc6-4f37-acda-fb06231da1ac tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:49.332306 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-efab1fdf-8bc6-4f37-acda-fb06231da1ac tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:49.339131 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-efab1fdf-8bc6-4f37-acda-fb06231da1ac tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.339624 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-efab1fdf-8bc6-4f37-acda-fb06231da1ac tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.340394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-efab1fdf-8bc6-4f37-acda-fb06231da1ac tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.340831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-efab1fdf-8bc6-4f37-acda-fb06231da1ac tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.458047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:49.458565 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:49.464732 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.465170 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.465928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.466355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.480953 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-efab1fdf-8bc6-4f37-acda-fb06231da1ac tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:49.490678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-efab1fdf-8bc6-4f37-acda-fb06231da1ac tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.163005 Jul 11 21:01:49.499997 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 249/502] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:49 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:49.509935 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0adbd008-fdca-440d-bc9a-3b1ff72b22f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:49.510702 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0adbd008-fdca-440d-bc9a-3b1ff72b22f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:49.517376 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0adbd008-fdca-440d-bc9a-3b1ff72b22f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.517933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0adbd008-fdca-440d-bc9a-3b1ff72b22f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.518992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0adbd008-fdca-440d-bc9a-3b1ff72b22f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.519469 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0adbd008-fdca-440d-bc9a-3b1ff72b22f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.606892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:49.622164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:49.623908 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:49.625278 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d0620cda-adf3-4cba-a156-9f404036cbda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1746 microversion: 2.20 time: 0.172381 Jul 11 21:01:49.625941 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 254/503] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:49 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:49.630255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-c642e784-287e-4fa8-b688-26222137875f req-6d7e9820-3bd7-4611-9126-e9481e1e05de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd574c88-de3e-4736-a11a-23b4f2fe13ee", "name": "network-vif-plugged", "status": "completed", "tag": "b4c152ef-9a1e-409b-91a3-2e1fc3836703"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:49.638815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-c642e784-287e-4fa8-b688-26222137875f req-6d7e9820-3bd7-4611-9126-e9481e1e05de service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.639295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-c642e784-287e-4fa8-b688-26222137875f req-6d7e9820-3bd7-4611-9126-e9481e1e05de service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.651117 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-c642e784-287e-4fa8-b688-26222137875f req-6d7e9820-3bd7-4611-9126-e9481e1e05de service nova] Creating event network-vif-plugged:b4c152ef-9a1e-409b-91a3-2e1fc3836703 for instance fd574c88-de3e-4736-a11a-23b4f2fe13ee on hv-cinder-84902 Jul 11 21:01:49.656451 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-c642e784-287e-4fa8-b688-26222137875f req-6d7e9820-3bd7-4611-9126-e9481e1e05de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029371 Jul 11 21:01:49.657315 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 255/504] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:01:49.664577 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0adbd008-fdca-440d-bc9a-3b1ff72b22f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:49.672325 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0adbd008-fdca-440d-bc9a-3b1ff72b22f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1452 microversion: 2.1 time: 0.166385 Jul 11 21:01:49.672924 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 250/505] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:49 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:49.689285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-eeab818c-98fb-4d8c-b466-5d00f79d26de tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:49.689973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-eeab818c-98fb-4d8c-b466-5d00f79d26de tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:49.697163 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-eeab818c-98fb-4d8c-b466-5d00f79d26de tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.697607 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-eeab818c-98fb-4d8c-b466-5d00f79d26de tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.698362 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-eeab818c-98fb-4d8c-b466-5d00f79d26de tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:49.698961 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-eeab818c-98fb-4d8c-b466-5d00f79d26de tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:49.834292 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-eeab818c-98fb-4d8c-b466-5d00f79d26de tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:49.845719 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-eeab818c-98fb-4d8c-b466-5d00f79d26de tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1452 microversion: 2.1 time: 0.160928 Jul 11 21:01:49.846303 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 256/506] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:49 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:50.292739 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-204a3462-d7df-47ff-b426-5028dfcd0ee6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:50.293339 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-204a3462-d7df-47ff-b426-5028dfcd0ee6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:50.299602 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-204a3462-d7df-47ff-b426-5028dfcd0ee6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:50.300040 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-204a3462-d7df-47ff-b426-5028dfcd0ee6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:50.300797 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-204a3462-d7df-47ff-b426-5028dfcd0ee6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:50.301254 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-204a3462-d7df-47ff-b426-5028dfcd0ee6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:50.438186 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-204a3462-d7df-47ff-b426-5028dfcd0ee6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:50.447139 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-204a3462-d7df-47ff-b426-5028dfcd0ee6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.158266 Jul 11 21:01:50.447742 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 251/507] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:50 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:50.507006 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c3633f15-1bde-4ee8-919e-f6538ff4aed8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:50.507558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c3633f15-1bde-4ee8-919e-f6538ff4aed8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:50.513914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c3633f15-1bde-4ee8-919e-f6538ff4aed8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:50.514389 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c3633f15-1bde-4ee8-919e-f6538ff4aed8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:50.515180 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c3633f15-1bde-4ee8-919e-f6538ff4aed8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:50.515736 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c3633f15-1bde-4ee8-919e-f6538ff4aed8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:50.644874 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:50.645690 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:50.652146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:50.652665 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:50.653500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:50.654009 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:50.720872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c3633f15-1bde-4ee8-919e-f6538ff4aed8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:50.729872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c3633f15-1bde-4ee8-919e-f6538ff4aed8 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.226835 Jul 11 21:01:50.730445 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 257/508] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:50 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:50.787818 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:50.796491 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:50.798167 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:50.799388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f6b8e2a4-f697-48c3-9d15-9e7f698758dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1746 microversion: 2.20 time: 0.158722 Jul 11 21:01:50.799939 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 252/509] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:50 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:51.465126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fc162492-a2b8-44b7-aa7d-48628ad488c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:51.465740 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fc162492-a2b8-44b7-aa7d-48628ad488c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:51.472408 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fc162492-a2b8-44b7-aa7d-48628ad488c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:51.472863 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fc162492-a2b8-44b7-aa7d-48628ad488c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:51.473678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fc162492-a2b8-44b7-aa7d-48628ad488c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:51.474078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fc162492-a2b8-44b7-aa7d-48628ad488c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:51.626979 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-48adfb6c-4064-4e93-9064-53ab7166edad req-7396e921-1ca8-496d-b4db-316d6fbb0cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab48eb9-c7dd-477d-9722-c03b4e165059", "tag": "4eb794cf-2acb-4971-9c22-8e3d115edb88"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:51.642735 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-48adfb6c-4064-4e93-9064-53ab7166edad req-7396e921-1ca8-496d-b4db-316d6fbb0cdb service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:51.643290 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-48adfb6c-4064-4e93-9064-53ab7166edad req-7396e921-1ca8-496d-b4db-316d6fbb0cdb service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:51.647987 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fc162492-a2b8-44b7-aa7d-48628ad488c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:51.656125 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-48adfb6c-4064-4e93-9064-53ab7166edad req-7396e921-1ca8-496d-b4db-316d6fbb0cdb service nova] Creating event network-changed:4eb794cf-2acb-4971-9c22-8e3d115edb88 for instance aab48eb9-c7dd-477d-9722-c03b4e165059 on hv-cinder-84902 Jul 11 21:01:51.656944 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fc162492-a2b8-44b7-aa7d-48628ad488c4 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.196183 Jul 11 21:01:51.657513 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 258/510] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:51 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:51.661611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-48adfb6c-4064-4e93-9064-53ab7166edad req-7396e921-1ca8-496d-b4db-316d6fbb0cdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042004 Jul 11 21:01:51.662578 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 253/511] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:01:51.747031 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-01bb4ff1-c755-4c26-8ad0-0e8e0c6e995b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:51.747637 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-01bb4ff1-c755-4c26-8ad0-0e8e0c6e995b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:51.754099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-01bb4ff1-c755-4c26-8ad0-0e8e0c6e995b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:51.754548 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-01bb4ff1-c755-4c26-8ad0-0e8e0c6e995b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:51.755329 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-01bb4ff1-c755-4c26-8ad0-0e8e0c6e995b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:51.755746 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-01bb4ff1-c755-4c26-8ad0-0e8e0c6e995b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:51.819078 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:51.820054 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:51.827258 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:51.827979 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:51.828947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:51.829549 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:51.907593 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-01bb4ff1-c755-4c26-8ad0-0e8e0c6e995b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:51.915358 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-01bb4ff1-c755-4c26-8ad0-0e8e0c6e995b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1317 microversion: 2.1 time: 0.172215 Jul 11 21:01:51.916095 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 259/512] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:51 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:52.017456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:52.030876 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:52.032449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:52.033640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-26ce83c6-5595-40ed-8238-606f2a8355d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1746 microversion: 2.20 time: 0.218953 Jul 11 21:01:52.034177 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 254/513] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:51 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1746 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:52.674342 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8f089ee4-a4ab-4ab8-bb2c-5e3b221262b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:52.675029 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8f089ee4-a4ab-4ab8-bb2c-5e3b221262b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:52.681904 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8f089ee4-a4ab-4ab8-bb2c-5e3b221262b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:52.682437 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8f089ee4-a4ab-4ab8-bb2c-5e3b221262b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:52.683267 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8f089ee4-a4ab-4ab8-bb2c-5e3b221262b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:52.683786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8f089ee4-a4ab-4ab8-bb2c-5e3b221262b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:52.816449 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8f089ee4-a4ab-4ab8-bb2c-5e3b221262b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:52.825020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8f089ee4-a4ab-4ab8-bb2c-5e3b221262b7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.154722 Jul 11 21:01:52.825610 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 260/514] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:52 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:52.933471 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ee94143d-0bdb-4ce5-9d06-e06c65a6111b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:52.934083 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ee94143d-0bdb-4ce5-9d06-e06c65a6111b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:52.942246 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee94143d-0bdb-4ce5-9d06-e06c65a6111b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:52.943863 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee94143d-0bdb-4ce5-9d06-e06c65a6111b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:52.944728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee94143d-0bdb-4ce5-9d06-e06c65a6111b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:52.945165 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee94143d-0bdb-4ce5-9d06-e06c65a6111b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:53.052275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:53.053289 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:53.059678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:53.060680 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:53.061561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:53.062006 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:53.176064 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ee94143d-0bdb-4ce5-9d06-e06c65a6111b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:53.184737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ee94143d-0bdb-4ce5-9d06-e06c65a6111b tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1504 microversion: 2.1 time: 0.255138 Jul 11 21:01:53.185313 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 255/515] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:52 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:53.201497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:53.204815 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-68503725-d1c7-4704-a82b-efe1f530fc42 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5207200-638b-49c5-8021-f1b4209a2f15", "device": "/dev/sdb"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:53.205895 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-68503725-d1c7-4704-a82b-efe1f530fc42 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:53.209779 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:53.211503 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:53.212066 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-68503725-d1c7-4704-a82b-efe1f530fc42 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:53.212553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-68503725-d1c7-4704-a82b-efe1f530fc42 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:53.213047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3306b14d-22de-43d7-9068-b0a845247af5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1746 microversion: 2.20 time: 0.164882 Jul 11 21:01:53.213774 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-68503725-d1c7-4704-a82b-efe1f530fc42 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:53.213980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 261/516] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:53 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:53.214086 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-68503725-d1c7-4704-a82b-efe1f530fc42 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:53.474834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:53.496866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-68503725-d1c7-4704-a82b-efe1f530fc42 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "POST /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296173 Jul 11 21:01:53.497703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 256/517] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:01:53 2022] POST /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:01:53.540716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-86c9f92f-ef08-4fd5-b167-22468e7a327b req-e352a4ac-6d69-4549-b690-421b3ab3a41c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1536f24e-dc7b-4eaf-9b73-32205dbca872", "name": "network-vif-plugged", "status": "completed", "tag": "6878cb2c-c95a-44b5-8449-0da5fe06d309"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:53.549748 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-86c9f92f-ef08-4fd5-b167-22468e7a327b req-e352a4ac-6d69-4549-b690-421b3ab3a41c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:53.550130 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-86c9f92f-ef08-4fd5-b167-22468e7a327b req-e352a4ac-6d69-4549-b690-421b3ab3a41c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:53.562113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-86c9f92f-ef08-4fd5-b167-22468e7a327b req-e352a4ac-6d69-4549-b690-421b3ab3a41c service nova] Creating event network-vif-plugged:6878cb2c-c95a-44b5-8449-0da5fe06d309 for instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 on hv-cinder-84902 Jul 11 21:01:53.567114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-86c9f92f-ef08-4fd5-b167-22468e7a327b req-e352a4ac-6d69-4549-b690-421b3ab3a41c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030341 Jul 11 21:01:53.567721 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 262/518] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:01:53.843468 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-491d6eaf-e4ad-4ad5-b331-75f03041cbf8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:53.844322 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-491d6eaf-e4ad-4ad5-b331-75f03041cbf8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:53.851891 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-491d6eaf-e4ad-4ad5-b331-75f03041cbf8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:53.852367 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-491d6eaf-e4ad-4ad5-b331-75f03041cbf8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:53.853154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-491d6eaf-e4ad-4ad5-b331-75f03041cbf8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:53.853586 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-491d6eaf-e4ad-4ad5-b331-75f03041cbf8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:54.002339 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-491d6eaf-e4ad-4ad5-b331-75f03041cbf8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:54.010649 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-491d6eaf-e4ad-4ad5-b331-75f03041cbf8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.171526 Jul 11 21:01:54.011240 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 257/519] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:53 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:54.235021 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:54.235854 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:54.244761 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:54.245350 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:54.246350 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:54.246916 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:54.385302 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:54.393560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:54.395030 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:54.396205 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-799bc9dd-ae84-439c-ba51-3bbaaa79f9b8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1746 microversion: 2.20 time: 0.167347 Jul 11 21:01:54.396756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 263/520] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:54 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:55.031496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4bb4a61c-bab9-4390-ae23-11b486771faf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:55.032680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4bb4a61c-bab9-4390-ae23-11b486771faf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:55.039801 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4bb4a61c-bab9-4390-ae23-11b486771faf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:55.040406 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4bb4a61c-bab9-4390-ae23-11b486771faf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:55.041187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4bb4a61c-bab9-4390-ae23-11b486771faf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:55.041623 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4bb4a61c-bab9-4390-ae23-11b486771faf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:55.179517 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4bb4a61c-bab9-4390-ae23-11b486771faf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:55.188532 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4bb4a61c-bab9-4390-ae23-11b486771faf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.163201 Jul 11 21:01:55.189118 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 258/521] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:55 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:55.423628 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:55.424189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:55.431401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:55.431837 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:55.432636 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:55.433061 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:55.569514 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:55.574934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=100 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:01:55.581647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:55.583632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:55.585364 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c2fdfe7d-bf31-469f-9242-c71c9f217bf0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1746 microversion: 2.20 time: 0.167894 Jul 11 21:01:55.586199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 264/522] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:55 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:56.209786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1358b227-366c-4f22-84c9-01fa19d8705b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:56.210751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1358b227-366c-4f22-84c9-01fa19d8705b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:56.220955 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1358b227-366c-4f22-84c9-01fa19d8705b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:56.221401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1358b227-366c-4f22-84c9-01fa19d8705b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:56.222154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1358b227-366c-4f22-84c9-01fa19d8705b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:56.222581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1358b227-366c-4f22-84c9-01fa19d8705b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:56.369381 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1358b227-366c-4f22-84c9-01fa19d8705b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:56.378199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1358b227-366c-4f22-84c9-01fa19d8705b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1699 microversion: 2.1 time: 0.174849 Jul 11 21:01:56.378780 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 259/523] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:56 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1699 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:56.395527 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-43a115ac-82e4-4343-8d17-13d321440321 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:01:56.402335 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43a115ac-82e4-4343-8d17-13d321440321 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:56.402776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43a115ac-82e4-4343-8d17-13d321440321 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:56.425674 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-43a115ac-82e4-4343-8d17-13d321440321 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Going to try to start instance {{(pid=118013) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 11 21:01:56.472759 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-43a115ac-82e4-4343-8d17-13d321440321 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/action" status: 202 len: 0 microversion: 2.1 time: 0.081387 Jul 11 21:01:56.473267 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 265/524] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:01:56 2022] POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:01:56.481477 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b7b6c87d-97d6-4d58-85a5-b0f58db09fa3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:56.482087 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-b7b6c87d-97d6-4d58-85a5-b0f58db09fa3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:56.488611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b7b6c87d-97d6-4d58-85a5-b0f58db09fa3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:56.489294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b7b6c87d-97d6-4d58-85a5-b0f58db09fa3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:56.490071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b7b6c87d-97d6-4d58-85a5-b0f58db09fa3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:56.490502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b7b6c87d-97d6-4d58-85a5-b0f58db09fa3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:56.607583 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:56.609079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:56.618385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:56.618953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:56.619733 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:56.620421 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:56.641262 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-b7b6c87d-97d6-4d58-85a5-b0f58db09fa3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:56.655364 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b7b6c87d-97d6-4d58-85a5-b0f58db09fa3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1708 microversion: 2.1 time: 0.173032 Jul 11 21:01:56.656616 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 260/525] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:56 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1708 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:56.793197 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:56.801841 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:56.803687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:56.805024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c8dc8dfd-a44f-4441-a37e-9a29d8d1810f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.201831 Jul 11 21:01:56.805573 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 266/526] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:56 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 21:01:57.674983 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7b6d3fe4-5aeb-4416-a25d-5633087aee88 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:57.675592 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7b6d3fe4-5aeb-4416-a25d-5633087aee88 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:57.694105 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7b6d3fe4-5aeb-4416-a25d-5633087aee88 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:57.695019 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7b6d3fe4-5aeb-4416-a25d-5633087aee88 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:57.696420 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7b6d3fe4-5aeb-4416-a25d-5633087aee88 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:57.697079 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7b6d3fe4-5aeb-4416-a25d-5633087aee88 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:57.830584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:57.832441 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:57.848087 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:57.848598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:57.849517 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:57.850447 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:57.887782 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7b6d3fe4-5aeb-4416-a25d-5633087aee88 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:57.897147 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7b6d3fe4-5aeb-4416-a25d-5633087aee88 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1708 microversion: 2.1 time: 0.226477 Jul 11 21:01:57.898266 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 261/527] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:57 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1708 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:58.031906 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:58.040673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:58.042253 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:58.043626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-988556d4-70f8-4f73-adc1-c1afb642640b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.223061 Jul 11 21:01:58.044471 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 267/528] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:57 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:01:58.917318 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8ac19000-5cca-40d4-acd6-9e2acce5cc03 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:58.917986 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8ac19000-5cca-40d4-acd6-9e2acce5cc03 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:58.925088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8ac19000-5cca-40d4-acd6-9e2acce5cc03 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:58.925782 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8ac19000-5cca-40d4-acd6-9e2acce5cc03 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:58.927285 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8ac19000-5cca-40d4-acd6-9e2acce5cc03 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:58.928257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8ac19000-5cca-40d4-acd6-9e2acce5cc03 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:59.068602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:01:59.069957 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:01:59.074405 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8ac19000-5cca-40d4-acd6-9e2acce5cc03 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:59.076883 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:59.077415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:59.078241 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:01:59.078834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:01:59.082684 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8ac19000-5cca-40d4-acd6-9e2acce5cc03 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1712 microversion: 2.1 time: 0.169231 Jul 11 21:01:59.083263 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 262/529] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:01:58 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1712 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:01:59.209763 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:59.217835 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:59.219434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:01:59.220620 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ca45569f-51b2-43eb-8daf-1126de7f0e0d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.155931 Jul 11 21:01:59.221186 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 268/530] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:01:59 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:00.239486 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:00.240833 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:00.247503 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:00.248146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:00.249165 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:00.249592 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:00.420489 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:00.430340 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:00.432193 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:00.433468 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-06c4ee41-fb20-48f1-93ca-6dc4f45f34a5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.198540 Jul 11 21:02:00.434513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 263/531] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:00 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:01.452842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:01.454448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:01.460950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:01.461399 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:01.462175 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:01.462611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:01.600614 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:01.609378 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:01.611096 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:01.612294 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-de666d67-a11b-4e9b-8d26-85b202c73c3b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.163384 Jul 11 21:02:01.614425 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 269/532] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:01 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:02.633469 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:02.634259 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:02.641306 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:02.641877 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:02.642630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:02.643076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:02.782434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:02.792285 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:02.793783 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:02.794944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-06cce7d8-9eeb-42cf-bdf6-b598fcc3fe18 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.165487 Jul 11 21:02:02.795505 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 264/533] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:02 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:03.814072 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:03.815296 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:03.823049 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:03.823775 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:03.824737 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:03.825168 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:03.974109 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:03.984798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:03.986277 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:03.987548 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-15c2138f-79d5-409f-98ba-5f2b6b9c5683 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.177552 Jul 11 21:02:03.988706 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 270/534] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:03 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:05.008368 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:05.009912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:05.026256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:05.027199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:05.028199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:05.028908 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:05.185464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:05.193683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:05.195500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:05.196727 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-936d61d6-f2d1-4ff2-88af-eb8ac753a381 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.194524 Jul 11 21:02:05.197518 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 265/535] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:05 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:06.215018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:06.216373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:06.223066 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:06.223581 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:06.224429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:06.225078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:06.365491 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:06.373676 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:06.375151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:06.376407 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-43add860-0e51-4c9f-a041-a3f20c61f21f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.165274 Jul 11 21:02:06.376948 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 271/536] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:06 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:07.399541 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:07.400711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:07.410250 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:07.410697 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:07.411454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:07.411882 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:07.551713 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:07.564098 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:07.565606 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:07.566769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-35927725-2be5-463e-9854-4545c88a4449 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.174282 Jul 11 21:02:07.567332 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 266/537] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:07 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:08.586146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:08.586736 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:08.592683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:08.593448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:08.594297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:08.594815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:08.740511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:08.749619 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:08.751105 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:08.752435 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a17eb06f-79c7-4637-aeea-9d92a1577b4c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1741 microversion: 2.20 time: 0.170374 Jul 11 21:02:08.753015 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 272/538] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:08 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:09.770711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:09.771315 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:09.778303 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:09.778753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:09.779514 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:09.779947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:09.921206 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:09.930271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:09.931758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:09.932935 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f8f0180f-0029-4d88-b328-ee36836e92f6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1723 microversion: 2.20 time: 0.166454 Jul 11 21:02:09.933495 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 267/539] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:09 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:10.952750 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:10.953324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:10.959944 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:10.960351 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:10.961111 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:10.961538 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:11.106933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:11.117777 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:11.119842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:11.121647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2b5221c4-2b62-426b-907c-ef1957f323bd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1723 microversion: 2.20 time: 0.172649 Jul 11 21:02:11.122417 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 273/540] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:10 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:12.144809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:12.145805 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:12.157208 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:12.158035 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:12.159440 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:12.159857 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:12.312315 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:12.320850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:12.322340 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:12.323502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6c330a72-357f-4931-a2a0-5e34119304d6 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1723 microversion: 2.20 time: 0.185395 Jul 11 21:02:12.324072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 268/541] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:12 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:13.347175 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:13.347815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:13.354895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:13.355353 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:13.356185 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:13.356799 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:13.498574 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:13.506981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:13.508519 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:13.509678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1f5ec490-c9ca-41d4-b47f-7935b8d104a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1723 microversion: 2.20 time: 0.168718 Jul 11 21:02:13.510252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 274/542] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:13 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:14.445587 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-a6d1a18e-3bed-4809-9237-264a3ecc5f1a req-80d8668c-ef19-4501-8aa5-dccebf4ac0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1536f24e-dc7b-4eaf-9b73-32205dbca872", "name": "network-vif-unplugged", "status": "completed", "tag": "6878cb2c-c95a-44b5-8449-0da5fe06d309"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:02:14.454674 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-a6d1a18e-3bed-4809-9237-264a3ecc5f1a req-80d8668c-ef19-4501-8aa5-dccebf4ac0af service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:14.455109 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-a6d1a18e-3bed-4809-9237-264a3ecc5f1a req-80d8668c-ef19-4501-8aa5-dccebf4ac0af service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:14.467709 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-a6d1a18e-3bed-4809-9237-264a3ecc5f1a req-80d8668c-ef19-4501-8aa5-dccebf4ac0af service nova] Creating event network-vif-unplugged:6878cb2c-c95a-44b5-8449-0da5fe06d309 for instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 on hv-cinder-84902 Jul 11 21:02:14.473201 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-a6d1a18e-3bed-4809-9237-264a3ecc5f1a req-80d8668c-ef19-4501-8aa5-dccebf4ac0af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031367 Jul 11 21:02:14.474016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 269/543] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:02:14.531752 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:14.532813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:14.542055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:14.542687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:14.543892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:14.544638 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:14.684458 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:14.692434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:14.693908 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:14.695051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-687a0cb0-5206-459b-85b8-4488b7cfe9dd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1723 microversion: 2.20 time: 0.169709 Jul 11 21:02:14.695609 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 275/544] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:14 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:15.718104 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:15.719214 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:15.727667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:15.728198 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:15.728894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:15.729319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:15.868137 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:15.877826 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:15.879555 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:15.880729 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-24118b83-29ac-4c74-9cda-68f640502300 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1723 microversion: 2.20 time: 0.169900 Jul 11 21:02:15.881282 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 270/545] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:15 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:16.903312 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:16.904450 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:16.907597 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=54 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:16.916514 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:16.917226 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:16.918480 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:16.919183 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:17.065125 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:17.073649 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:17.075610 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:17.077197 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-abf21591-b2bf-41dc-91c1-f0a04b92b1ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1726 microversion: 2.20 time: 0.180560 Jul 11 21:02:17.077890 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 276/546] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:16 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:17.095564 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f341e112-6336-4ce5-bae9-e1212ef72795 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bcd121b-e329-403b-b797-a25fdbcec2ee"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:02:17.096614 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f341e112-6336-4ce5-bae9-e1212ef72795 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:17.103171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f341e112-6336-4ce5-bae9-e1212ef72795 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:17.103618 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f341e112-6336-4ce5-bae9-e1212ef72795 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:17.104455 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f341e112-6336-4ce5-bae9-e1212ef72795 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:17.105099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f341e112-6336-4ce5-bae9-e1212ef72795 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:17.313065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:17.407728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f341e112-6336-4ce5-bae9-e1212ef72795 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316143 Jul 11 21:02:17.408379 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 271/547] 10.222.0.20 () {62 vars in 1363 bytes} [Mon Jul 11 21:02:17 2022] POST /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments => generated 188 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 21:02:17.532379 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fe12ba72-750f-409e-afab-54e3677cb83c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:02:17.532934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fe12ba72-750f-409e-afab-54e3677cb83c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:17.539535 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe12ba72-750f-409e-afab-54e3677cb83c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:17.539979 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe12ba72-750f-409e-afab-54e3677cb83c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:17.540796 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe12ba72-750f-409e-afab-54e3677cb83c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:17.541221 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fe12ba72-750f-409e-afab-54e3677cb83c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:17.639460 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fe12ba72-750f-409e-afab-54e3677cb83c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/action" status: 202 len: 0 microversion: 2.20 time: 0.110990 Jul 11 21:02:17.640211 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 277/548] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jul 11 21:02:17 2022] POST /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:02:17.648482 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:17.649119 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:17.651616 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=51 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:17.657487 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:17.658048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:17.658900 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:17.659401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:17.796872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:17.806051 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:17.807559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:17.808751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bb3470fe-0e49-4126-bddb-ab2ce7c30d87 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1752 microversion: 2.20 time: 0.164407 Jul 11 21:02:17.809349 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 272/549] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:17 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:18.828045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:18.828639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:18.835797 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:18.836278 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:18.837051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:18.837454 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:18.975313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:18.984232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:18.985669 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:18.986823 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-652ec481-d295-4374-a3d7-519399ee4d41 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1754 microversion: 2.20 time: 0.162830 Jul 11 21:02:18.987392 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 278/550] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:18 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:19.243983 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b51a21c3-5cdf-42f1-bfbe-ac4ec56567fa tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:19.244525 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-b51a21c3-5cdf-42f1-bfbe-ac4ec56567fa tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:19.251315 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b51a21c3-5cdf-42f1-bfbe-ac4ec56567fa tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:19.251758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b51a21c3-5cdf-42f1-bfbe-ac4ec56567fa tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:19.252553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b51a21c3-5cdf-42f1-bfbe-ac4ec56567fa tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:19.252986 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b51a21c3-5cdf-42f1-bfbe-ac4ec56567fa tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:19.377941 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-b51a21c3-5cdf-42f1-bfbe-ac4ec56567fa tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lazy-loading 'services' on Instance uuid fd574c88-de3e-4736-a11a-23b4f2fe13ee {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:02:19.502807 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b51a21c3-5cdf-42f1-bfbe-ac4ec56567fa tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee/os-volume_attachments/e5207200-638b-49c5-8021-f1b4209a2f15" status: 202 len: 0 microversion: 2.1 time: 0.262731 Jul 11 21:02:19.503424 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 273/551] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:02:19 2022] DELETE /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee/os-volume_attachments/e5207200-638b-49c5-8021-f1b4209a2f15 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:02:20.010230 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:20.011016 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:20.021384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:20.021968 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:20.022722 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:20.023147 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:20.041661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:20.216152 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:20.230183 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:20.233652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:20.235670 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ef173f84-8e46-414c-abf3-bfd0e55c2d69 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1754 microversion: 2.20 time: 0.232200 Jul 11 21:02:20.236406 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 279/552] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:20 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1754 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:21.258536 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:21.259593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:21.268593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:21.269202 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:21.270480 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:21.271243 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:21.464433 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:21.477646 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:21.479991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:21.481630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9857f4a3-2677-40ba-98dc-60805d6b3233 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.229930 Jul 11 21:02:21.482345 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 274/553] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:21 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:21.684238 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0339ea85-7e30-4f57-a2e7-26820976bd14 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:21.684746 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0339ea85-7e30-4f57-a2e7-26820976bd14 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:21.691337 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0339ea85-7e30-4f57-a2e7-26820976bd14 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:21.691806 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0339ea85-7e30-4f57-a2e7-26820976bd14 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:21.692560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0339ea85-7e30-4f57-a2e7-26820976bd14 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:21.692988 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0339ea85-7e30-4f57-a2e7-26820976bd14 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:21.717903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0339ea85-7e30-4f57-a2e7-26820976bd14 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:02:21.817467 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0339ea85-7e30-4f57-a2e7-26820976bd14 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 204 len: 0 microversion: 2.1 time: 0.134001 Jul 11 21:02:21.820590 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 280/554] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:02:21 2022] DELETE /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:02:21.827483 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bc56b879-4f67-472e-8186-42afe604f4e7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:21.828975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bc56b879-4f67-472e-8186-42afe604f4e7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:21.841964 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc56b879-4f67-472e-8186-42afe604f4e7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:21.845341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc56b879-4f67-472e-8186-42afe604f4e7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:21.846253 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc56b879-4f67-472e-8186-42afe604f4e7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:21.848314 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc56b879-4f67-472e-8186-42afe604f4e7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:22.001030 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bc56b879-4f67-472e-8186-42afe604f4e7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:22.008872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bc56b879-4f67-472e-8186-42afe604f4e7 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.186046 Jul 11 21:02:22.009415 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 275/555] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:21 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:22.505465 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:22.506597 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:22.513297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:22.513760 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:22.514514 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:22.514938 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:22.658205 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:22.672356 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:22.674734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:22.676563 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d1f33b97-8839-4ea0-b883-b059873f094f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.177900 Jul 11 21:02:22.677705 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 281/556] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:22 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:23.030567 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-253e160c-83ab-44cf-b60b-9fa1c89dd0d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:23.031439 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-253e160c-83ab-44cf-b60b-9fa1c89dd0d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:23.041296 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-253e160c-83ab-44cf-b60b-9fa1c89dd0d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:23.041743 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-253e160c-83ab-44cf-b60b-9fa1c89dd0d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:23.042511 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-253e160c-83ab-44cf-b60b-9fa1c89dd0d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:23.042940 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-253e160c-83ab-44cf-b60b-9fa1c89dd0d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:23.173757 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-253e160c-83ab-44cf-b60b-9fa1c89dd0d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:23.182158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-253e160c-83ab-44cf-b60b-9fa1c89dd0d1 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.158196 Jul 11 21:02:23.182770 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 276/557] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:23 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:23.697012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:23.698295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:23.705379 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:23.705854 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:23.706628 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:23.707061 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:23.862810 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:23.871978 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:23.873509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:23.874677 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2fe07d92-6704-4e6d-ac3f-d562498ec692 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.181799 Jul 11 21:02:23.875358 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 282/558] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:23 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:24.209196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d4fe77de-ad82-42ca-bd4d-13e8e0b3ac50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:24.209806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d4fe77de-ad82-42ca-bd4d-13e8e0b3ac50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:24.217084 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d4fe77de-ad82-42ca-bd4d-13e8e0b3ac50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:24.217532 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d4fe77de-ad82-42ca-bd4d-13e8e0b3ac50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:24.218339 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d4fe77de-ad82-42ca-bd4d-13e8e0b3ac50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:24.218732 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d4fe77de-ad82-42ca-bd4d-13e8e0b3ac50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:24.356811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d4fe77de-ad82-42ca-bd4d-13e8e0b3ac50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:24.365002 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d4fe77de-ad82-42ca-bd4d-13e8e0b3ac50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.160417 Jul 11 21:02:24.365574 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 277/559] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:24 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:24.893511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:24.894166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:24.902108 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:24.902547 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:24.903374 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:24.903877 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:25.043393 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:25.052037 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:25.053900 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:25.055043 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2bd31689-1bee-4843-abac-87933b7efe44 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.165555 Jul 11 21:02:25.058505 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 283/560] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:24 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:25.382174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b85b2a59-fb03-4017-bccc-284bb4e9a9b2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:25.382771 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-b85b2a59-fb03-4017-bccc-284bb4e9a9b2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:25.390066 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b85b2a59-fb03-4017-bccc-284bb4e9a9b2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:25.390512 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b85b2a59-fb03-4017-bccc-284bb4e9a9b2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:25.391286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b85b2a59-fb03-4017-bccc-284bb4e9a9b2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:25.391719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b85b2a59-fb03-4017-bccc-284bb4e9a9b2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:25.535738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-b85b2a59-fb03-4017-bccc-284bb4e9a9b2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:25.546767 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b85b2a59-fb03-4017-bccc-284bb4e9a9b2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.168801 Jul 11 21:02:25.557670 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 278/561] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:25 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:26.074923 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:26.075550 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:26.082470 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:26.082944 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:26.083687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:26.084151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:26.470912 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:26.480901 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:26.482572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:26.483755 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2fd00a45-9594-4086-b0b5-1852d4e3da74 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.413369 Jul 11 21:02:26.484569 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 284/562] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:26 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:26.565382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-924ff34f-a420-4fa2-86d9-dcecaeac7a7d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:26.566008 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-924ff34f-a420-4fa2-86d9-dcecaeac7a7d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:26.573257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-924ff34f-a420-4fa2-86d9-dcecaeac7a7d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:26.573707 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-924ff34f-a420-4fa2-86d9-dcecaeac7a7d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:26.574480 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-924ff34f-a420-4fa2-86d9-dcecaeac7a7d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:26.574918 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-924ff34f-a420-4fa2-86d9-dcecaeac7a7d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:26.733319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-924ff34f-a420-4fa2-86d9-dcecaeac7a7d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:26.741457 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-924ff34f-a420-4fa2-86d9-dcecaeac7a7d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.180722 Jul 11 21:02:26.742034 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 279/563] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:26 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:27.503078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:27.503685 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:27.510233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:27.510894 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:27.511576 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:27.512016 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:27.647745 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:27.656648 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:27.658330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:27.659525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e17876d8-3fb2-4b26-8844-6ca59e338d5d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.160459 Jul 11 21:02:27.660120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 285/564] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:27 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:27.759064 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8b595529-c1c5-4e50-a90b-832c62f095a3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:27.759629 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8b595529-c1c5-4e50-a90b-832c62f095a3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:27.767976 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b595529-c1c5-4e50-a90b-832c62f095a3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:27.768469 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b595529-c1c5-4e50-a90b-832c62f095a3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:27.769248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b595529-c1c5-4e50-a90b-832c62f095a3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:27.769685 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b595529-c1c5-4e50-a90b-832c62f095a3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:28.189701 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8b595529-c1c5-4e50-a90b-832c62f095a3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:28.197552 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8b595529-c1c5-4e50-a90b-832c62f095a3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.442547 Jul 11 21:02:28.198189 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 280/565] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:27 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:28.678895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:28.679631 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:28.686546 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:28.687057 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:28.687920 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:28.688586 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:28.829092 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:28.838261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:28.839970 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:28.841248 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1094adc5-1ae5-4fde-ba49-972dc148c762 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.166946 Jul 11 21:02:28.841789 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 286/566] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:28 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:29.214917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0f983729-91bd-4d63-874e-4c2034ed29c2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:29.215729 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0f983729-91bd-4d63-874e-4c2034ed29c2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:29.222486 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0f983729-91bd-4d63-874e-4c2034ed29c2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:29.222949 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0f983729-91bd-4d63-874e-4c2034ed29c2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:29.223700 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0f983729-91bd-4d63-874e-4c2034ed29c2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:29.224136 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0f983729-91bd-4d63-874e-4c2034ed29c2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:29.360165 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0f983729-91bd-4d63-874e-4c2034ed29c2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:29.367896 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0f983729-91bd-4d63-874e-4c2034ed29c2 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.157014 Jul 11 21:02:29.368715 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 281/567] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:29 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:29.860283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:29.861875 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:29.869754 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:29.870310 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:29.871099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:29.871523 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:30.008469 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:30.020691 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:30.022985 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:30.024813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-351e710c-8b19-4d4b-845e-7d33dd3f534c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.169392 Jul 11 21:02:30.025646 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 287/568] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:29 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:30.385060 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1f2e9e7a-f46d-469b-9e19-81fb2c2f9d55 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:30.385702 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1f2e9e7a-f46d-469b-9e19-81fb2c2f9d55 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:30.393106 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1f2e9e7a-f46d-469b-9e19-81fb2c2f9d55 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:30.393554 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1f2e9e7a-f46d-469b-9e19-81fb2c2f9d55 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:30.394325 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1f2e9e7a-f46d-469b-9e19-81fb2c2f9d55 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:30.394754 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1f2e9e7a-f46d-469b-9e19-81fb2c2f9d55 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:30.538115 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1f2e9e7a-f46d-469b-9e19-81fb2c2f9d55 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:30.546317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1f2e9e7a-f46d-469b-9e19-81fb2c2f9d55 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.164895 Jul 11 21:02:30.547112 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 282/569] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:30 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:31.044227 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:31.044821 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:31.051438 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:31.051891 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:31.053047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:31.053475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:31.203794 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:31.213320 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:31.215163 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:31.216634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e413dce3-91ab-4285-8e6d-ba514bd35377 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.176517 Jul 11 21:02:31.227786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 288/570] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:31 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:31.563983 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8a5b1141-718b-4a5d-99f7-0577802a1fd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:31.564828 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8a5b1141-718b-4a5d-99f7-0577802a1fd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:31.572317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8a5b1141-718b-4a5d-99f7-0577802a1fd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:31.572667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8a5b1141-718b-4a5d-99f7-0577802a1fd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:31.573436 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8a5b1141-718b-4a5d-99f7-0577802a1fd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:31.573862 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8a5b1141-718b-4a5d-99f7-0577802a1fd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:31.712627 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8a5b1141-718b-4a5d-99f7-0577802a1fd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:31.720711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8a5b1141-718b-4a5d-99f7-0577802a1fd3 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.160503 Jul 11 21:02:31.726332 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 283/571] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:31 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:32.235951 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:32.236926 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:32.243758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:32.244236 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:32.245011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:32.245441 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:32.387664 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:32.396548 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:32.398049 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:32.399235 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6d423f92-cf1e-4b50-90d1-9d2cc8690298 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.168125 Jul 11 21:02:32.399779 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 289/572] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:32 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:32.739403 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4bb9f4ba-8c23-487f-90bf-d68c452ecb39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:32.739998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4bb9f4ba-8c23-487f-90bf-d68c452ecb39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:32.747209 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4bb9f4ba-8c23-487f-90bf-d68c452ecb39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:32.747650 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4bb9f4ba-8c23-487f-90bf-d68c452ecb39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:32.748447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4bb9f4ba-8c23-487f-90bf-d68c452ecb39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:32.748886 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4bb9f4ba-8c23-487f-90bf-d68c452ecb39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:32.887899 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4bb9f4ba-8c23-487f-90bf-d68c452ecb39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:32.896024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4bb9f4ba-8c23-487f-90bf-d68c452ecb39 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.160701 Jul 11 21:02:32.896756 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 284/573] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:32 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:33.425426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:33.426035 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:33.432802 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:33.433264 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:33.434016 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:33.434445 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:33.563677 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:33.572436 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:33.573917 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:33.575064 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b31b89fd-6584-48e7-93f4-eeabe959667c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.153836 Jul 11 21:02:33.575620 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 290/574] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:33 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:33.917438 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-01d9eed1-911f-4c87-b56a-1c0ae2eabcea tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:33.918445 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-01d9eed1-911f-4c87-b56a-1c0ae2eabcea tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:33.929825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-01d9eed1-911f-4c87-b56a-1c0ae2eabcea tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:33.930563 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-01d9eed1-911f-4c87-b56a-1c0ae2eabcea tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:33.931808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-01d9eed1-911f-4c87-b56a-1c0ae2eabcea tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:33.932568 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-01d9eed1-911f-4c87-b56a-1c0ae2eabcea tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:34.072580 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-01d9eed1-911f-4c87-b56a-1c0ae2eabcea tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:34.080770 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-01d9eed1-911f-4c87-b56a-1c0ae2eabcea tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.169967 Jul 11 21:02:34.081345 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 285/575] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:33 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:34.596827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:34.598151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:34.605359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:34.605859 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:34.606703 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:34.607215 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:34.752929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:34.761520 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:34.763004 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:34.764150 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4df14616-1e2b-4894-a5d0-75a89daf8a8d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.172786 Jul 11 21:02:34.764755 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 291/576] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:34 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:35.107339 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d7db9495-9ce6-4e7e-994a-3565d8c0de25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:35.108295 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d7db9495-9ce6-4e7e-994a-3565d8c0de25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:35.115968 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7db9495-9ce6-4e7e-994a-3565d8c0de25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:35.116463 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7db9495-9ce6-4e7e-994a-3565d8c0de25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:35.117252 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7db9495-9ce6-4e7e-994a-3565d8c0de25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:35.117696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7db9495-9ce6-4e7e-994a-3565d8c0de25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:35.261367 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d7db9495-9ce6-4e7e-994a-3565d8c0de25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:35.266482 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:35.274475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d7db9495-9ce6-4e7e-994a-3565d8c0de25 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.173232 Jul 11 21:02:35.275171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 286/577] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:35 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:35.783525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:35.784231 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:35.791520 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:35.792008 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:35.792882 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:35.793353 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:35.924356 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:35.933578 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:35.935591 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:35.936802 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2147e86e-897d-479c-b99d-a912e635f7b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.157688 Jul 11 21:02:35.937763 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 292/578] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:35 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:36.297677 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7d79f97c-7a99-46ea-bb2e-5440a5120bcf tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:36.298281 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7d79f97c-7a99-46ea-bb2e-5440a5120bcf tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:36.306109 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7d79f97c-7a99-46ea-bb2e-5440a5120bcf tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:36.306556 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7d79f97c-7a99-46ea-bb2e-5440a5120bcf tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:36.307316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7d79f97c-7a99-46ea-bb2e-5440a5120bcf tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:36.307733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7d79f97c-7a99-46ea-bb2e-5440a5120bcf tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:36.444307 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7d79f97c-7a99-46ea-bb2e-5440a5120bcf tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:36.452130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7d79f97c-7a99-46ea-bb2e-5440a5120bcf tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.160740 Jul 11 21:02:36.452722 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 287/579] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:36 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:37.081026 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:37.081631 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:37.088153 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:37.088603 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:37.089358 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:37.090045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:37.240837 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:37.249322 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:37.250853 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:37.252004 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-427ed21a-5038-44a5-bce6-6a4d0fdc4a49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.292933 Jul 11 21:02:37.252601 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 293/580] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:36 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:37.472261 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8eda9645-55be-450c-a6dd-ad4ff468fd3a tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:37.472828 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8eda9645-55be-450c-a6dd-ad4ff468fd3a tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:37.479758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8eda9645-55be-450c-a6dd-ad4ff468fd3a tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:37.480234 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8eda9645-55be-450c-a6dd-ad4ff468fd3a tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:37.480998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8eda9645-55be-450c-a6dd-ad4ff468fd3a tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:37.481432 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8eda9645-55be-450c-a6dd-ad4ff468fd3a tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:37.661194 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8eda9645-55be-450c-a6dd-ad4ff468fd3a tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:37.669492 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8eda9645-55be-450c-a6dd-ad4ff468fd3a tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.202575 Jul 11 21:02:37.670059 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 288/581] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:37 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:38.275289 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:38.276380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:38.285523 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:38.285975 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:38.286736 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:38.287173 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:38.307190 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:38.434217 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:38.443647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:38.445254 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:38.446411 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-cf0975a4-a3dd-4470-877c-742c155c16f5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.177928 Jul 11 21:02:38.446948 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 294/582] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:38 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:38.692286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-abfde203-8cb5-443c-831f-c6b285d50a50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:38.693251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-abfde203-8cb5-443c-831f-c6b285d50a50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:38.704874 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-abfde203-8cb5-443c-831f-c6b285d50a50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:38.705330 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-abfde203-8cb5-443c-831f-c6b285d50a50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:38.706101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-abfde203-8cb5-443c-831f-c6b285d50a50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:38.706535 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-abfde203-8cb5-443c-831f-c6b285d50a50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:38.843679 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-abfde203-8cb5-443c-831f-c6b285d50a50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:38.855493 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-abfde203-8cb5-443c-831f-c6b285d50a50 tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1510 microversion: 2.1 time: 0.170748 Jul 11 21:02:38.856056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 289/583] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:38 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:39.465673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:39.466274 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:39.473086 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:39.473560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:39.474321 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:39.474745 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:39.609448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:39.619061 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:39.620619 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:39.621781 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6f90da57-7398-4384-838e-5ee4c0a7bf22 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.160104 Jul 11 21:02:39.622331 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 295/584] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:39 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:39.874741 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-41122149-3bf1-43e2-be59-dc52e5d1c52e req-54ee347a-9ef2-4d2d-a3fe-b03b39e790bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd574c88-de3e-4736-a11a-23b4f2fe13ee", "name": "network-vif-deleted", "tag": "b4c152ef-9a1e-409b-91a3-2e1fc3836703"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:02:39.875318 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5d679f24-63e3-4783-b86d-16ec85a3ec4c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:39.875496 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5d679f24-63e3-4783-b86d-16ec85a3ec4c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:39.882050 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d679f24-63e3-4783-b86d-16ec85a3ec4c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:39.882771 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d679f24-63e3-4783-b86d-16ec85a3ec4c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:39.883695 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d679f24-63e3-4783-b86d-16ec85a3ec4c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:39.884427 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d679f24-63e3-4783-b86d-16ec85a3ec4c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:39.893136 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-41122149-3bf1-43e2-be59-dc52e5d1c52e req-54ee347a-9ef2-4d2d-a3fe-b03b39e790bd service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:39.894092 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-41122149-3bf1-43e2-be59-dc52e5d1c52e req-54ee347a-9ef2-4d2d-a3fe-b03b39e790bd service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:39.906266 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-41122149-3bf1-43e2-be59-dc52e5d1c52e req-54ee347a-9ef2-4d2d-a3fe-b03b39e790bd service nova] Creating event network-vif-deleted:b4c152ef-9a1e-409b-91a3-2e1fc3836703 for instance fd574c88-de3e-4736-a11a-23b4f2fe13ee on hv-cinder-84902 Jul 11 21:02:39.911774 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-41122149-3bf1-43e2-be59-dc52e5d1c52e req-54ee347a-9ef2-4d2d-a3fe-b03b39e790bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040570 Jul 11 21:02:39.913024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 290/585] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:02:39.960802 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5d679f24-63e3-4783-b86d-16ec85a3ec4c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ec8ab7842a443c922a39f5ffcfd51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d40e24cac74460bbbed4dffce9a4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:39.968452 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5d679f24-63e3-4783-b86d-16ec85a3ec4c tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 200 len: 1468 microversion: 2.1 time: 0.097488 Jul 11 21:02:39.969033 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 296/586] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:39 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 1468 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:02:40.642422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:40.643169 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:40.650814 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:40.651318 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:40.652221 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:40.652739 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:40.798175 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:40.807850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:40.809384 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:40.810564 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c933332b-2b70-43d6-bc8e-e583610c8b19 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.173422 Jul 11 21:02:40.811150 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 291/587] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:40 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:40.988519 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:40.989214 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] [instance: fd574c88-de3e-4736-a11a-23b4f2fe13ee] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:40.996830 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:40.997297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:40.998183 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:40.998679 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:41.017091 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] HTTP exception thrown: Instance fd574c88-de3e-4736-a11a-23b4f2fe13ee could not be found. Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Request method failure captured: Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee HTTP/1.1 Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI80cL_-agWRf93iFDkt5OlckFrFEyKk8psSe--J6kF63ovpWPN7MWKEbSYZ3FbXV2J7eJsz_nBw8WhyXfHbXcKz7tdS-XJGgkxhBkNWR9bMJWIFe3H-5L-WRsWFEYd_hSJzt1_Blw37FOBbuzkO7ZxyOirWRXnxBOE2B6af6GMWXtM Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 36d40e24cac74460bbbed4dffce9a4da Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1834755868 Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:02:41.018684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36d40e24cac74460bbbed4dffce9a4da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36d40e24cac74460bbbed4dffce9a4da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36d40e24cac74460bbbed4dffce9a4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36d40e24cac74460bbbed4dffce9a4da", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesSnapshotTestJSON-1834755868 Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 36d40e24cac74460bbbed4dffce9a4da Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1834755868 Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesSnapshotTestJSON-1834755868-project Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 63ec8ab7842a443c922a39f5ffcfd51a Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesSnapshotTestJSON-1834755868-project Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance fd574c88-de3e-4736-a11a-23b4f2fe13ee could not be found. Jul 11 21:02:41.020255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'fd574c88-de3e-4736-a11a-23b4f2fe13ee'} Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd574c88-de3e-4736-a11a-23b4f2fe13ee could not be found. Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:02:41.021209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd574c88-de3e-4736-a11a-23b4f2fe13ee could not be found. Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd574c88-de3e-4736-a11a-23b4f2fe13ee could not be found. Jul 11 21:02:41.022872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:02:41.024100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] Returning 404 to user: Instance fd574c88-de3e-4736-a11a-23b4f2fe13ee could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:02:41.024100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-04274f98-44d1-4509-a31b-f56db919a96d tempest-VolumesSnapshotTestJSON-1834755868 tempest-VolumesSnapshotTestJSON-1834755868-project] 10.222.0.20 "GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee" status: 404 len: 111 microversion: 2.1 time: 0.036973 Jul 11 21:02:41.024100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 297/588] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:02:40 2022] GET /compute/v2.1/servers/fd574c88-de3e-4736-a11a-23b4f2fe13ee => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:02:41.829501 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:41.830123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:41.837351 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:41.837786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:41.838546 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:41.838971 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:41.985052 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:41.999327 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:42.001885 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:42.003240 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-da024983-ceec-4c54-90b0-ff814bb5c0b4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.177848 Jul 11 21:02:42.003866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 292/589] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:41 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:43.026511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:43.027496 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:43.038032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:43.038780 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:43.040021 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:43.040786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:43.175334 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:43.184938 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:43.186470 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:43.187635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3ba52168-aa7a-45dc-ac38-bb8f403ea447 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.167771 Jul 11 21:02:43.188214 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 298/590] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:43 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:44.210182 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:44.211095 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:44.222019 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:44.222494 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:44.223250 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:44.223682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:44.364346 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:44.373203 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:44.374712 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:44.375858 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ad7941bd-4414-49dd-903b-ceae1a9e4a38 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.172242 Jul 11 21:02:44.376446 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 293/591] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:44 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:45.403253 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:45.404070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:45.413214 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:45.413807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:45.414828 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:45.415423 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:45.569574 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:45.582502 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:45.584001 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:45.585276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e852929a-6103-47dd-bf3d-a266d7ee2da5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.187380 Jul 11 21:02:45.585851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 299/592] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:45 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:46.607828 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:46.608754 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:46.619784 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:46.620511 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:46.621779 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:46.622475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:46.768417 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:46.776602 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:46.778080 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:46.779226 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f814ffb0-c4c6-4c31-922b-372b78741d4f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.177867 Jul 11 21:02:46.779788 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 294/593] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:46 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:47.798250 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:47.798963 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:47.802047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:47.808423 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:47.809065 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:47.810206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:47.810776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:47.950814 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:47.959290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:47.960813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:47.961963 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-89c514fc-8fba-4996-a112-8e427979876b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.168228 Jul 11 21:02:47.962513 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 300/594] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:47 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:48.984375 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:48.985372 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:48.989082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=46 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:48.994777 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:48.995220 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:48.995980 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:48.996443 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:49.133691 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:49.142770 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:49.144299 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:49.145758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-95f44e22-bece-4b0b-8c47-d2f0cf44a11d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.168028 Jul 11 21:02:49.146323 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 295/595] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:48 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:50.167881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:50.168909 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:50.179820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:50.180648 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:50.181917 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:50.182622 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:50.316387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:50.325541 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:50.327126 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:50.328315 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-53c5cc70-4e16-4a4d-b0de-5147063644fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.167047 Jul 11 21:02:50.328894 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 301/596] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:50 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:51.351311 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:51.352419 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:51.363346 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:51.363817 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:51.364614 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:51.365042 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:51.495550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:51.504012 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:51.505574 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:51.506785 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-aa58717b-ee40-4cd0-8b97-8bc29becc59f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.162173 Jul 11 21:02:51.507382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 296/597] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:51 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:52.529341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:52.530293 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:52.538564 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:52.539000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:52.539750 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:52.540229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:52.687032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:52.698395 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:52.698772 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:52.700065 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2f4f58dd-7576-484c-9b03-c9a9fa0cf946 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.177358 Jul 11 21:02:52.700882 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 302/598] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:52 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:52.764455 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-7caa6680-f278-4853-a5e5-9ca4d9a8792e req-37bea8d1-d8b9-486e-b5cd-f819f8d264c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1536f24e-dc7b-4eaf-9b73-32205dbca872", "name": "network-vif-plugged", "status": "completed", "tag": "6878cb2c-c95a-44b5-8449-0da5fe06d309"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:02:52.775851 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-7caa6680-f278-4853-a5e5-9ca4d9a8792e req-37bea8d1-d8b9-486e-b5cd-f819f8d264c9 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:52.776480 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-7caa6680-f278-4853-a5e5-9ca4d9a8792e req-37bea8d1-d8b9-486e-b5cd-f819f8d264c9 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:52.789364 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-7caa6680-f278-4853-a5e5-9ca4d9a8792e req-37bea8d1-d8b9-486e-b5cd-f819f8d264c9 service nova] Creating event network-vif-plugged:6878cb2c-c95a-44b5-8449-0da5fe06d309 for instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 on hv-cinder-84902 Jul 11 21:02:52.794057 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-7caa6680-f278-4853-a5e5-9ca4d9a8792e req-37bea8d1-d8b9-486e-b5cd-f819f8d264c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034627 Jul 11 21:02:52.794942 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 297/599] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:02:53.722589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:53.723841 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:53.734087 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:53.734859 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:53.736182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:53.736928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:53.876174 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:53.885019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:53.886512 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:53.887672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8055f171-e171-4b3b-acf5-729642767eed tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.171657 Jul 11 21:02:53.888251 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 303/600] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:53 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:54.910210 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:54.910983 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:54.917713 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:54.918170 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:54.918937 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:54.919371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:55.053504 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:55.062071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:55.063581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:55.064752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-92e39631-4bd2-467c-829d-2c1d8cc85c8a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.161855 Jul 11 21:02:55.065325 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 298/601] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:54 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:56.085809 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:56.086347 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:56.092860 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:56.093303 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:56.094067 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:56.094495 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:56.226027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:56.234557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:56.236057 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:56.237270 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b79d029f-eb64-40e5-9c66-50edf06ffaf4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.156357 Jul 11 21:02:56.237834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 304/602] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:56 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:57.254811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:57.255414 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:57.262297 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:57.262738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:57.263487 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:57.263915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:57.450972 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:57.462521 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:57.464013 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:57.465179 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5d5af9bf-5593-4fc0-beff-1d9d76234945 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.214351 Jul 11 21:02:57.465746 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 299/603] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:57 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:58.490568 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:58.491113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:58.497606 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:58.498052 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:58.498837 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:58.499269 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:58.685383 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:58.698954 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:58.701469 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:58.703139 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b1a14536-90cc-444f-b494-60948a433036 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.216413 Jul 11 21:02:58.703950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 305/604] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:58 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:02:59.724454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:02:59.725220 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:02:59.731818 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:59.732300 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:59.733068 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:02:59.733506 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:02:59.872778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:59.882159 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:59.884239 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:02:59.885955 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-185cb6f0-5844-4798-83bc-5ef50acba7a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1810 microversion: 2.20 time: 0.165310 Jul 11 21:02:59.886719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 300/605] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:02:59 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:03:00.910690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:00.911366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:00.917800 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:00.918243 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:00.919004 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:00.919430 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:01.076326 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:01.085805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:01.087297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:01.088473 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2a87d0e8-f2be-4627-a0ec-2d88fec795f9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1797 microversion: 2.20 time: 0.182751 Jul 11 21:03:01.089010 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 306/606] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:03:00 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1797 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:03:03.453280 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:03:03.453280 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Mon Jul 11 21:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:03:18.814580 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=11 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:18.816091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=76 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:19.142832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-adcfd5df-125f-4156-8ca7-d39c2a1ec7c4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3631bd83-6dd6-4b13-8c0f-4e2e5428330e"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:03:19.144906 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-adcfd5df-125f-4156-8ca7-d39c2a1ec7c4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:19.152864 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-adcfd5df-125f-4156-8ca7-d39c2a1ec7c4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:19.153306 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-adcfd5df-125f-4156-8ca7-d39c2a1ec7c4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:19.154244 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-adcfd5df-125f-4156-8ca7-d39c2a1ec7c4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:19.154929 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-adcfd5df-125f-4156-8ca7-d39c2a1ec7c4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:19.496270 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-adcfd5df-125f-4156-8ca7-d39c2a1ec7c4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.686901 Jul 11 21:03:19.497187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 301/607] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:03:18 2022] POST /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments => generated 194 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:03:27.075398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-af210a44-17ee-4346-ba6e-9a75f27fb490 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:03:27.076676 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-af210a44-17ee-4346-ba6e-9a75f27fb490 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:27.080063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=13 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:27.080904 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=70 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:27.084757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af210a44-17ee-4346-ba6e-9a75f27fb490 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:27.085144 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af210a44-17ee-4346-ba6e-9a75f27fb490 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:27.085990 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af210a44-17ee-4346-ba6e-9a75f27fb490 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:27.086380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af210a44-17ee-4346-ba6e-9a75f27fb490 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:27.111540 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-af210a44-17ee-4346-ba6e-9a75f27fb490 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lazy-loading 'flavor' on Instance uuid 49fff1a4-e60c-436d-b94c-e4e414557cbe {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:03:27.259693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-af210a44-17ee-4346-ba6e-9a75f27fb490 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/action" status: 200 len: 32 microversion: 2.1 time: 0.187921 Jul 11 21:03:27.260199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 307/608] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:03:27 2022] POST /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 21:03:27.271353 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8ab87480-bab8-41a4-bde5-53b3c540ca01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:27.272656 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8ab87480-bab8-41a4-bde5-53b3c540ca01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:27.283062 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8ab87480-bab8-41a4-bde5-53b3c540ca01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:27.283749 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8ab87480-bab8-41a4-bde5-53b3c540ca01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:27.284632 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8ab87480-bab8-41a4-bde5-53b3c540ca01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:27.285057 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8ab87480-bab8-41a4-bde5-53b3c540ca01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:27.505471 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8ab87480-bab8-41a4-bde5-53b3c540ca01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:27.514032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8ab87480-bab8-41a4-bde5-53b3c540ca01 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.247811 Jul 11 21:03:27.525696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 302/609] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:27 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:28.391562 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a74d5968-d9ee-465a-8723-84603bf81d73 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Action: 'create', calling method: .version_select at 0x7f38402a6550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-266614097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEa/bVIz6bL2OCi0kIHR/o7v01XsPkGRuOssr+i8FIiO8kvNGK+t81IV/9W5PhtYeB7rI+bHC14PMiGwXzI/3ypWkIR8X5tT27vgN2xIw8CJJYK2E4V4Zk/DTHNH1xsBg=="}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:03:28.406324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-a74d5968-d9ee-465a-8723-84603bf81d73 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Getting quotas for project 6f54283593cd4e71ba6b700377bf0b4e. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:03:28.410258 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-a74d5968-d9ee-465a-8723-84603bf81d73 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Getting quotas for user de2fb55182604091b35826b2c2fd090c and project 6f54283593cd4e71ba6b700377bf0b4e. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:03:28.435432 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a74d5968-d9ee-465a-8723-84603bf81d73 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048034 Jul 11 21:03:28.436249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 308/610] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 21:03:28 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:03:28.531108 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d297742d-bc25-4069-8f6a-95f376636cd8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:28.531756 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d297742d-bc25-4069-8f6a-95f376636cd8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:28.538540 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d297742d-bc25-4069-8f6a-95f376636cd8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:28.538917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d297742d-bc25-4069-8f6a-95f376636cd8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:28.539761 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d297742d-bc25-4069-8f6a-95f376636cd8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:28.540298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d297742d-bc25-4069-8f6a-95f376636cd8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:28.549689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1397681827", "imageRef": "5b05dedf-5022-4578-8441-b8bc95ea45c0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-266614097", "networks": [{"uuid": "04ef5647-ff50-4017-89e8-d897756ca16f"}]}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:03:28.603172 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.network.neutron [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] validate_networks() for [('04ef5647-ff50-4017-89e8-d897756ca16f', None, None, None, None, None)] {{(pid=118013) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:03:28.682669 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d297742d-bc25-4069-8f6a-95f376636cd8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:28.690858 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d297742d-bc25-4069-8f6a-95f376636cd8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.163805 Jul 11 21:03:28.691545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 303/611] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:28 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:29.090624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Flavor limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:03:29.091070 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Image limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:03:29.091501 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Flavor pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:03:29.091900 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Image pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:03:29.092334 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:03:29.101476 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:29.101914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:29.102689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:29.103116 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:29.119585 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Getting quotas for project 6f54283593cd4e71ba6b700377bf0b4e. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:03:29.123598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Getting quotas for user de2fb55182604091b35826b2c2fd090c and project 6f54283593cd4e71ba6b700377bf0b4e. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:03:29.134704 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Going to run 1 instances... {{(pid=118013) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:03:29.137058 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b05dedf-5022-4578-8441-b8bc95ea45c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118013) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:03:29.182268 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8792e97c-a487-45d6-8a3d-48ad4301c10b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637729 Jul 11 21:03:29.183117 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 309/612] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:03:29.192920 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a7e577cf-ea30-4b79-a33f-1baa990b7689 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:29.193522 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a7e577cf-ea30-4b79-a33f-1baa990b7689 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:29.251876 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a7e577cf-ea30-4b79-a33f-1baa990b7689 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:29.258720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a7e577cf-ea30-4b79-a33f-1baa990b7689 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1258 microversion: 2.1 time: 0.069626 Jul 11 21:03:29.259301 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 304/613] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:29 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:29.709313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-09fbf3ab-1cfd-46df-8e90-17f39d67aab4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:29.710159 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-09fbf3ab-1cfd-46df-8e90-17f39d67aab4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:29.717679 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09fbf3ab-1cfd-46df-8e90-17f39d67aab4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:29.718409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09fbf3ab-1cfd-46df-8e90-17f39d67aab4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:29.719182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09fbf3ab-1cfd-46df-8e90-17f39d67aab4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:29.719647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09fbf3ab-1cfd-46df-8e90-17f39d67aab4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:29.856694 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-09fbf3ab-1cfd-46df-8e90-17f39d67aab4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:29.865355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-09fbf3ab-1cfd-46df-8e90-17f39d67aab4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.160699 Jul 11 21:03:29.866001 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 310/614] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:29 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:30.279048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f7ef167b-844c-4cb0-8607-e0c65b34b96d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:30.280049 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f7ef167b-844c-4cb0-8607-e0c65b34b96d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:30.288553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f7ef167b-844c-4cb0-8607-e0c65b34b96d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:30.288997 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f7ef167b-844c-4cb0-8607-e0c65b34b96d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:30.289759 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f7ef167b-844c-4cb0-8607-e0c65b34b96d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:30.290188 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f7ef167b-844c-4cb0-8607-e0c65b34b96d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:30.353615 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f7ef167b-844c-4cb0-8607-e0c65b34b96d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:30.361234 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f7ef167b-844c-4cb0-8607-e0c65b34b96d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1310 microversion: 2.1 time: 0.088678 Jul 11 21:03:30.361766 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 305/615] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:30 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:30.883996 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5c460aff-0227-4ce0-9b11-d97a7ff3d736 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:30.885624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5c460aff-0227-4ce0-9b11-d97a7ff3d736 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:30.891716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c460aff-0227-4ce0-9b11-d97a7ff3d736 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:30.893080 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c460aff-0227-4ce0-9b11-d97a7ff3d736 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:30.893992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c460aff-0227-4ce0-9b11-d97a7ff3d736 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:30.894528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c460aff-0227-4ce0-9b11-d97a7ff3d736 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:31.086999 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5c460aff-0227-4ce0-9b11-d97a7ff3d736 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:31.100445 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5c460aff-0227-4ce0-9b11-d97a7ff3d736 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.220377 Jul 11 21:03:31.101471 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 311/616] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:30 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:31.379159 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1993c93a-c290-4474-a977-defe6bd5f7c4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:31.380008 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1993c93a-c290-4474-a977-defe6bd5f7c4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:31.391916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1993c93a-c290-4474-a977-defe6bd5f7c4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:31.392498 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1993c93a-c290-4474-a977-defe6bd5f7c4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:31.393364 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1993c93a-c290-4474-a977-defe6bd5f7c4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:31.393910 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1993c93a-c290-4474-a977-defe6bd5f7c4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:31.595642 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1993c93a-c290-4474-a977-defe6bd5f7c4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:31.614187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1993c93a-c290-4474-a977-defe6bd5f7c4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.238824 Jul 11 21:03:31.626758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 306/617] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:31 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:32.119088 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-68bdb7d8-4190-4abd-8a4c-c99d024663b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:32.119694 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-68bdb7d8-4190-4abd-8a4c-c99d024663b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:32.126181 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68bdb7d8-4190-4abd-8a4c-c99d024663b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:32.126677 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68bdb7d8-4190-4abd-8a4c-c99d024663b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:32.127426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68bdb7d8-4190-4abd-8a4c-c99d024663b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:32.127854 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68bdb7d8-4190-4abd-8a4c-c99d024663b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:32.270716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-68bdb7d8-4190-4abd-8a4c-c99d024663b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:32.281040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-68bdb7d8-4190-4abd-8a4c-c99d024663b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.165986 Jul 11 21:03:32.281964 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 312/618] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:32 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:32.633524 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-90760cc0-1616-4b2e-a279-0531035ccd38 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:32.634316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-90760cc0-1616-4b2e-a279-0531035ccd38 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:32.642108 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90760cc0-1616-4b2e-a279-0531035ccd38 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:32.642523 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90760cc0-1616-4b2e-a279-0531035ccd38 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:32.643295 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90760cc0-1616-4b2e-a279-0531035ccd38 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:32.643719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90760cc0-1616-4b2e-a279-0531035ccd38 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:32.781156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-90760cc0-1616-4b2e-a279-0531035ccd38 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:32.789110 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-90760cc0-1616-4b2e-a279-0531035ccd38 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.159721 Jul 11 21:03:32.789676 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 307/619] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:32 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:33.299689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9d8ee8f4-bd8e-4c7e-859c-c6e427e098da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:33.300335 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9d8ee8f4-bd8e-4c7e-859c-c6e427e098da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:33.307142 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9d8ee8f4-bd8e-4c7e-859c-c6e427e098da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:33.307582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9d8ee8f4-bd8e-4c7e-859c-c6e427e098da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:33.308368 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9d8ee8f4-bd8e-4c7e-859c-c6e427e098da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:33.308834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9d8ee8f4-bd8e-4c7e-859c-c6e427e098da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:33.452498 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9d8ee8f4-bd8e-4c7e-859c-c6e427e098da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:33.461632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9d8ee8f4-bd8e-4c7e-859c-c6e427e098da tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.166477 Jul 11 21:03:33.463079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 313/620] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:33 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:33.808083 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d50aeed0-6e89-4b1f-afba-2b4c0781c138 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:33.809723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d50aeed0-6e89-4b1f-afba-2b4c0781c138 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:33.817427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d50aeed0-6e89-4b1f-afba-2b4c0781c138 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:33.818167 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d50aeed0-6e89-4b1f-afba-2b4c0781c138 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:33.819177 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d50aeed0-6e89-4b1f-afba-2b4c0781c138 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:33.819944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d50aeed0-6e89-4b1f-afba-2b4c0781c138 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:33.968839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d50aeed0-6e89-4b1f-afba-2b4c0781c138 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:33.977345 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d50aeed0-6e89-4b1f-afba-2b4c0781c138 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.173227 Jul 11 21:03:33.977933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 308/621] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:33 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:34.480131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7bd6b174-9a3a-45a6-94af-0eb9022a278c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:34.480754 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7bd6b174-9a3a-45a6-94af-0eb9022a278c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:34.487286 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7bd6b174-9a3a-45a6-94af-0eb9022a278c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:34.487742 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7bd6b174-9a3a-45a6-94af-0eb9022a278c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:34.488523 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7bd6b174-9a3a-45a6-94af-0eb9022a278c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:34.488974 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7bd6b174-9a3a-45a6-94af-0eb9022a278c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:34.635463 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7bd6b174-9a3a-45a6-94af-0eb9022a278c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:34.643894 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7bd6b174-9a3a-45a6-94af-0eb9022a278c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.167797 Jul 11 21:03:34.644512 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 314/622] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:34 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:34.995316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-11747061-173c-4251-90bb-511c5524b5a0 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:34.995922 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-11747061-173c-4251-90bb-511c5524b5a0 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:35.003921 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11747061-173c-4251-90bb-511c5524b5a0 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:35.004409 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11747061-173c-4251-90bb-511c5524b5a0 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:35.005168 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11747061-173c-4251-90bb-511c5524b5a0 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:35.005661 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11747061-173c-4251-90bb-511c5524b5a0 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:35.141758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-11747061-173c-4251-90bb-511c5524b5a0 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:35.149489 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-11747061-173c-4251-90bb-511c5524b5a0 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.158360 Jul 11 21:03:35.150016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 309/623] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:34 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:35.661826 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3f769349-ee05-4878-add9-4e8321162a98 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:35.662429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3f769349-ee05-4878-add9-4e8321162a98 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:35.669359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3f769349-ee05-4878-add9-4e8321162a98 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:35.669803 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3f769349-ee05-4878-add9-4e8321162a98 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:35.670602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3f769349-ee05-4878-add9-4e8321162a98 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:35.671031 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3f769349-ee05-4878-add9-4e8321162a98 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:35.804572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3f769349-ee05-4878-add9-4e8321162a98 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:35.817960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3f769349-ee05-4878-add9-4e8321162a98 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.160021 Jul 11 21:03:35.818661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 315/624] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:35 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:36.166505 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f64c035d-1c16-4a6d-b27a-38db2069e33a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:36.167103 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f64c035d-1c16-4a6d-b27a-38db2069e33a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:36.173768 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f64c035d-1c16-4a6d-b27a-38db2069e33a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:36.174202 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f64c035d-1c16-4a6d-b27a-38db2069e33a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:36.174961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f64c035d-1c16-4a6d-b27a-38db2069e33a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:36.175392 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f64c035d-1c16-4a6d-b27a-38db2069e33a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:36.322145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f64c035d-1c16-4a6d-b27a-38db2069e33a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:36.330484 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f64c035d-1c16-4a6d-b27a-38db2069e33a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.167804 Jul 11 21:03:36.336733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 310/625] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:36 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:36.837078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9a11237a-e4cc-4854-b64d-2a2c78ddf2e0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:36.837931 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9a11237a-e4cc-4854-b64d-2a2c78ddf2e0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:36.844859 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9a11237a-e4cc-4854-b64d-2a2c78ddf2e0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:36.845340 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9a11237a-e4cc-4854-b64d-2a2c78ddf2e0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:36.846122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9a11237a-e4cc-4854-b64d-2a2c78ddf2e0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:36.846604 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9a11237a-e4cc-4854-b64d-2a2c78ddf2e0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:36.980346 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9a11237a-e4cc-4854-b64d-2a2c78ddf2e0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:36.988990 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9a11237a-e4cc-4854-b64d-2a2c78ddf2e0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.157863 Jul 11 21:03:36.998950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 316/626] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:36 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:37.349379 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-67f002a1-9788-4ce8-975f-ec2833501ec2 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:37.350639 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-67f002a1-9788-4ce8-975f-ec2833501ec2 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:37.357661 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67f002a1-9788-4ce8-975f-ec2833501ec2 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:37.358102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67f002a1-9788-4ce8-975f-ec2833501ec2 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:37.358856 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67f002a1-9788-4ce8-975f-ec2833501ec2 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:37.359260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67f002a1-9788-4ce8-975f-ec2833501ec2 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:37.498394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-67f002a1-9788-4ce8-975f-ec2833501ec2 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:37.506237 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-67f002a1-9788-4ce8-975f-ec2833501ec2 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.160725 Jul 11 21:03:37.506851 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 311/627] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:37 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:38.007221 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-3beef0e7-aa8c-4b1e-a7cd-5764ef00bebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:38.008098 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-3beef0e7-aa8c-4b1e-a7cd-5764ef00bebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:38.016687 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3beef0e7-aa8c-4b1e-a7cd-5764ef00bebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:38.017123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3beef0e7-aa8c-4b1e-a7cd-5764ef00bebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:38.018093 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3beef0e7-aa8c-4b1e-a7cd-5764ef00bebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:38.018587 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3beef0e7-aa8c-4b1e-a7cd-5764ef00bebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:38.033415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ec927e8c-3322-4b44-b3f9-185470e0e3b1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:38.033932 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ec927e8c-3322-4b44-b3f9-185470e0e3b1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:38.040626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ec927e8c-3322-4b44-b3f9-185470e0e3b1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:38.040998 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ec927e8c-3322-4b44-b3f9-185470e0e3b1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:38.041776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ec927e8c-3322-4b44-b3f9-185470e0e3b1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:38.042210 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ec927e8c-3322-4b44-b3f9-185470e0e3b1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:38.132077 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-ec927e8c-3322-4b44-b3f9-185470e0e3b1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lazy-loading 'services' on Instance uuid 88d87067-da01-484a-86ca-e2ec49f5f15c {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:03:38.181038 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3beef0e7-aa8c-4b1e-a7cd-5764ef00bebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:38.190618 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-3beef0e7-aa8c-4b1e-a7cd-5764ef00bebc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.188040 Jul 11 21:03:38.192536 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 312/628] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:38 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:38.223079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ec927e8c-3322-4b44-b3f9-185470e0e3b1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/os-volume_attachments/36fb3156-5304-4a76-a8f6-dd6dd4d5d2f9" status: 202 len: 0 microversion: 2.1 time: 0.307720 Jul 11 21:03:38.226823 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 317/629] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:03:37 2022] DELETE /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/os-volume_attachments/36fb3156-5304-4a76-a8f6-dd6dd4d5d2f9 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:03:38.524086 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-424da519-a6ec-4274-bb31-c39db87b3c64 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:38.524821 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-424da519-a6ec-4274-bb31-c39db87b3c64 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:38.531478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-424da519-a6ec-4274-bb31-c39db87b3c64 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:38.532073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-424da519-a6ec-4274-bb31-c39db87b3c64 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:38.533140 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-424da519-a6ec-4274-bb31-c39db87b3c64 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:38.533657 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-424da519-a6ec-4274-bb31-c39db87b3c64 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:38.685823 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-424da519-a6ec-4274-bb31-c39db87b3c64 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:38.695160 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-424da519-a6ec-4274-bb31-c39db87b3c64 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.175477 Jul 11 21:03:38.695755 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 313/630] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:38 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:39.209963 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:39.210805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=10 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:39.214756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-91403c9a-dda6-4c9f-91c3-d02226dbc1fc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:39.215434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-91403c9a-dda6-4c9f-91c3-d02226dbc1fc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:39.222867 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-91403c9a-dda6-4c9f-91c3-d02226dbc1fc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:39.223310 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-91403c9a-dda6-4c9f-91c3-d02226dbc1fc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:39.224067 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-91403c9a-dda6-4c9f-91c3-d02226dbc1fc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:39.224527 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-91403c9a-dda6-4c9f-91c3-d02226dbc1fc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:39.372995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-91403c9a-dda6-4c9f-91c3-d02226dbc1fc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:39.382280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-91403c9a-dda6-4c9f-91c3-d02226dbc1fc tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.173338 Jul 11 21:03:39.382876 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 318/631] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:39 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:39.712826 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-073f84b6-e353-4bd6-8627-31284e1fd25e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:39.713413 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-073f84b6-e353-4bd6-8627-31284e1fd25e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:39.715479 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:39.721773 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-073f84b6-e353-4bd6-8627-31284e1fd25e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:39.722211 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-073f84b6-e353-4bd6-8627-31284e1fd25e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:39.722970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-073f84b6-e353-4bd6-8627-31284e1fd25e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:39.723397 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-073f84b6-e353-4bd6-8627-31284e1fd25e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:39.855529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-073f84b6-e353-4bd6-8627-31284e1fd25e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:39.866644 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-073f84b6-e353-4bd6-8627-31284e1fd25e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.157440 Jul 11 21:03:39.867438 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 314/632] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:39 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:40.400314 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-93aaa5ec-b389-4d4c-9443-0213b35d1f17 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:40.400927 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-93aaa5ec-b389-4d4c-9443-0213b35d1f17 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:40.407572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-93aaa5ec-b389-4d4c-9443-0213b35d1f17 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:40.408232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-93aaa5ec-b389-4d4c-9443-0213b35d1f17 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:40.409270 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-93aaa5ec-b389-4d4c-9443-0213b35d1f17 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:40.409687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-93aaa5ec-b389-4d4c-9443-0213b35d1f17 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:40.560584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-93aaa5ec-b389-4d4c-9443-0213b35d1f17 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:40.569140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-93aaa5ec-b389-4d4c-9443-0213b35d1f17 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.172707 Jul 11 21:03:40.569718 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 319/633] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:40 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:40.884061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1830bead-7e2c-45bd-8acf-0e1935e21f49 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:40.884690 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1830bead-7e2c-45bd-8acf-0e1935e21f49 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:40.891626 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1830bead-7e2c-45bd-8acf-0e1935e21f49 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:40.892072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1830bead-7e2c-45bd-8acf-0e1935e21f49 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:40.893222 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1830bead-7e2c-45bd-8acf-0e1935e21f49 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:40.893685 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1830bead-7e2c-45bd-8acf-0e1935e21f49 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:41.030914 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1830bead-7e2c-45bd-8acf-0e1935e21f49 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:41.042803 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1830bead-7e2c-45bd-8acf-0e1935e21f49 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.162345 Jul 11 21:03:41.043567 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 315/634] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:40 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:41.590409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-406ef9de-56bb-4537-b38d-7d32287f493b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:41.591411 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-406ef9de-56bb-4537-b38d-7d32287f493b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:41.601789 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-406ef9de-56bb-4537-b38d-7d32287f493b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:41.602528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-406ef9de-56bb-4537-b38d-7d32287f493b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:41.603780 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-406ef9de-56bb-4537-b38d-7d32287f493b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:41.604544 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-406ef9de-56bb-4537-b38d-7d32287f493b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:41.745516 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-406ef9de-56bb-4537-b38d-7d32287f493b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:41.758497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-406ef9de-56bb-4537-b38d-7d32287f493b tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.174390 Jul 11 21:03:41.759259 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 320/635] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:41 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:42.066628 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9e62558a-3355-4dda-a17b-815edf4b50df tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:42.067372 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9e62558a-3355-4dda-a17b-815edf4b50df tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:42.075450 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9e62558a-3355-4dda-a17b-815edf4b50df tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:42.075969 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9e62558a-3355-4dda-a17b-815edf4b50df tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:42.076887 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9e62558a-3355-4dda-a17b-815edf4b50df tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:42.077429 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9e62558a-3355-4dda-a17b-815edf4b50df tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:42.211822 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9e62558a-3355-4dda-a17b-815edf4b50df tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:42.219977 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9e62558a-3355-4dda-a17b-815edf4b50df tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.159904 Jul 11 21:03:42.220712 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 316/636] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:42 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:42.780620 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8f130571-0760-42f5-892d-fae361457d89 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:42.781492 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8f130571-0760-42f5-892d-fae361457d89 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:42.789310 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8f130571-0760-42f5-892d-fae361457d89 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:42.789753 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8f130571-0760-42f5-892d-fae361457d89 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:42.790515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8f130571-0760-42f5-892d-fae361457d89 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:42.790949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8f130571-0760-42f5-892d-fae361457d89 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:42.927043 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8f130571-0760-42f5-892d-fae361457d89 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:42.935465 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8f130571-0760-42f5-892d-fae361457d89 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.161551 Jul 11 21:03:42.936041 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 321/637] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:42 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:43.245659 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a835c9cb-12b1-4eb8-82fc-a58b563ea893 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:43.246678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a835c9cb-12b1-4eb8-82fc-a58b563ea893 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:43.257693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a835c9cb-12b1-4eb8-82fc-a58b563ea893 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:43.258448 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a835c9cb-12b1-4eb8-82fc-a58b563ea893 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:43.259708 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a835c9cb-12b1-4eb8-82fc-a58b563ea893 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:43.260509 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a835c9cb-12b1-4eb8-82fc-a58b563ea893 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:43.267154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:43.401768 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a835c9cb-12b1-4eb8-82fc-a58b563ea893 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:43.409592 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a835c9cb-12b1-4eb8-82fc-a58b563ea893 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.170640 Jul 11 21:03:43.410441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 317/638] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:43 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:43.955506 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-dc990416-e053-424a-90b9-098e73c247c2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:43.956077 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-dc990416-e053-424a-90b9-098e73c247c2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:43.963101 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dc990416-e053-424a-90b9-098e73c247c2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:43.963547 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dc990416-e053-424a-90b9-098e73c247c2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:43.964348 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dc990416-e053-424a-90b9-098e73c247c2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:43.964783 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-dc990416-e053-424a-90b9-098e73c247c2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:43.982842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:44.102896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-dc990416-e053-424a-90b9-098e73c247c2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:44.115101 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-dc990416-e053-424a-90b9-098e73c247c2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.165554 Jul 11 21:03:44.115950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 322/639] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:43 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:44.431550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ade6267c-07d4-4031-b1fd-bdb3d8e377fe tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:44.432642 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ade6267c-07d4-4031-b1fd-bdb3d8e377fe tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:44.443068 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ade6267c-07d4-4031-b1fd-bdb3d8e377fe tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:44.443499 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ade6267c-07d4-4031-b1fd-bdb3d8e377fe tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:44.444293 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ade6267c-07d4-4031-b1fd-bdb3d8e377fe tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:44.444716 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ade6267c-07d4-4031-b1fd-bdb3d8e377fe tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:44.590358 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ade6267c-07d4-4031-b1fd-bdb3d8e377fe tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:44.601966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ade6267c-07d4-4031-b1fd-bdb3d8e377fe tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.177463 Jul 11 21:03:44.602775 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 318/640] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:44 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:45.137375 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-bdc0dce4-605c-43fe-afed-fb37d047fdf2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:45.138005 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-bdc0dce4-605c-43fe-afed-fb37d047fdf2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:45.145829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bdc0dce4-605c-43fe-afed-fb37d047fdf2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:45.146654 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bdc0dce4-605c-43fe-afed-fb37d047fdf2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:45.147456 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bdc0dce4-605c-43fe-afed-fb37d047fdf2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:45.147839 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bdc0dce4-605c-43fe-afed-fb37d047fdf2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:45.310077 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-bdc0dce4-605c-43fe-afed-fb37d047fdf2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:45.318304 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-bdc0dce4-605c-43fe-afed-fb37d047fdf2 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.184919 Jul 11 21:03:45.318887 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 323/641] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:45 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:45.624134 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-90589250-7b8e-4bae-9d62-8dd65cbae5ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:45.625427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-90589250-7b8e-4bae-9d62-8dd65cbae5ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:45.636510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90589250-7b8e-4bae-9d62-8dd65cbae5ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:45.637229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90589250-7b8e-4bae-9d62-8dd65cbae5ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:45.638422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90589250-7b8e-4bae-9d62-8dd65cbae5ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:45.639248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90589250-7b8e-4bae-9d62-8dd65cbae5ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:45.888956 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-90589250-7b8e-4bae-9d62-8dd65cbae5ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:45.899422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-90589250-7b8e-4bae-9d62-8dd65cbae5ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.280145 Jul 11 21:03:45.909393 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 319/642] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:45 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:45.985037 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-b05a70f4-0a7a-4e4f-a488-7c4399f98e19 req-f37c2936-99de-403d-9f94-f2b54668a00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1013294-9d36-4435-8113-260bfdee6c2e", "tag": "f2193191-95da-4dac-8666-32647c0fe803"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:03:45.995895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b05a70f4-0a7a-4e4f-a488-7c4399f98e19 req-f37c2936-99de-403d-9f94-f2b54668a00e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:45.996638 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b05a70f4-0a7a-4e4f-a488-7c4399f98e19 req-f37c2936-99de-403d-9f94-f2b54668a00e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:46.010840 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-b05a70f4-0a7a-4e4f-a488-7c4399f98e19 req-f37c2936-99de-403d-9f94-f2b54668a00e service nova] Creating event network-changed:f2193191-95da-4dac-8666-32647c0fe803 for instance a1013294-9d36-4435-8113-260bfdee6c2e on hv-cinder-84902 Jul 11 21:03:46.016542 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-b05a70f4-0a7a-4e4f-a488-7c4399f98e19 req-f37c2936-99de-403d-9f94-f2b54668a00e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117282 Jul 11 21:03:46.017440 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 324/643] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:03:46.335919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cc069074-6fe0-4393-b4da-445015017ea5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:46.336561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cc069074-6fe0-4393-b4da-445015017ea5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:46.343367 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc069074-6fe0-4393-b4da-445015017ea5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:46.343810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc069074-6fe0-4393-b4da-445015017ea5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:46.344608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc069074-6fe0-4393-b4da-445015017ea5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:46.345067 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc069074-6fe0-4393-b4da-445015017ea5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:46.498637 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cc069074-6fe0-4393-b4da-445015017ea5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:46.507399 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cc069074-6fe0-4393-b4da-445015017ea5 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.176012 Jul 11 21:03:46.507972 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 320/644] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:46 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:46.815695 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b7fab67a-25d2-4b66-891e-419ceeb1494a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:03:46.822915 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7fab67a-25d2-4b66-891e-419ceeb1494a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:46.823355 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7fab67a-25d2-4b66-891e-419ceeb1494a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:46.846199 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b7fab67a-25d2-4b66-891e-419ceeb1494a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Going to try to stop instance {{(pid=118013) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 11 21:03:46.892301 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b7fab67a-25d2-4b66-891e-419ceeb1494a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/action" status: 202 len: 0 microversion: 2.1 time: 0.080750 Jul 11 21:03:46.892866 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 325/645] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:03:46 2022] POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:03:46.901656 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-578daa9f-03b9-48d8-8cf0-3bfb610cf958 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:46.902270 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-578daa9f-03b9-48d8-8cf0-3bfb610cf958 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:46.909288 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-578daa9f-03b9-48d8-8cf0-3bfb610cf958 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:46.909729 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-578daa9f-03b9-48d8-8cf0-3bfb610cf958 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:46.910523 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-578daa9f-03b9-48d8-8cf0-3bfb610cf958 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:46.910919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-578daa9f-03b9-48d8-8cf0-3bfb610cf958 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:46.918247 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f0b48dfb-1572-436a-883a-3d1968c180ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:46.919440 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f0b48dfb-1572-436a-883a-3d1968c180ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:46.928140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f0b48dfb-1572-436a-883a-3d1968c180ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:46.928617 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f0b48dfb-1572-436a-883a-3d1968c180ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:46.929391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f0b48dfb-1572-436a-883a-3d1968c180ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:46.929825 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f0b48dfb-1572-436a-883a-3d1968c180ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:47.045095 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-578daa9f-03b9-48d8-8cf0-3bfb610cf958 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:47.053932 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-578daa9f-03b9-48d8-8cf0-3bfb610cf958 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1722 microversion: 2.1 time: 0.156252 Jul 11 21:03:47.054513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 321/646] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:46 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:47.065266 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f0b48dfb-1572-436a-883a-3d1968c180ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:47.072992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f0b48dfb-1572-436a-883a-3d1968c180ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.160011 Jul 11 21:03:47.073551 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 326/647] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:46 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:47.529479 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4b585982-cc23-4fe0-a17b-96b24b21dc82 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:47.530677 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4b585982-cc23-4fe0-a17b-96b24b21dc82 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:47.540990 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b585982-cc23-4fe0-a17b-96b24b21dc82 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:47.541766 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b585982-cc23-4fe0-a17b-96b24b21dc82 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:47.543006 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b585982-cc23-4fe0-a17b-96b24b21dc82 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:47.543717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b585982-cc23-4fe0-a17b-96b24b21dc82 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:47.707205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4b585982-cc23-4fe0-a17b-96b24b21dc82 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:47.715588 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4b585982-cc23-4fe0-a17b-96b24b21dc82 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.192601 Jul 11 21:03:47.716199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 322/648] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:47 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:48.071668 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5d2834a7-c93d-4cf1-a48c-a82b8f8a07c7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:48.072216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5d2834a7-c93d-4cf1-a48c-a82b8f8a07c7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:48.078552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d2834a7-c93d-4cf1-a48c-a82b8f8a07c7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:48.078997 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d2834a7-c93d-4cf1-a48c-a82b8f8a07c7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:48.079755 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d2834a7-c93d-4cf1-a48c-a82b8f8a07c7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:48.080211 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d2834a7-c93d-4cf1-a48c-a82b8f8a07c7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:48.090067 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d67bd5b5-1626-40b6-9ba3-1886ac5cba0c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:48.091446 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d67bd5b5-1626-40b6-9ba3-1886ac5cba0c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:48.098633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d67bd5b5-1626-40b6-9ba3-1886ac5cba0c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:48.099037 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d67bd5b5-1626-40b6-9ba3-1886ac5cba0c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:48.100007 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d67bd5b5-1626-40b6-9ba3-1886ac5cba0c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:48.100641 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d67bd5b5-1626-40b6-9ba3-1886ac5cba0c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:48.268990 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5d2834a7-c93d-4cf1-a48c-a82b8f8a07c7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:48.277336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5d2834a7-c93d-4cf1-a48c-a82b8f8a07c7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.209596 Jul 11 21:03:48.278231 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 327/649] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:48 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:48.639214 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d67bd5b5-1626-40b6-9ba3-1886ac5cba0c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:48.647265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d67bd5b5-1626-40b6-9ba3-1886ac5cba0c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.560998 Jul 11 21:03:48.647769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 323/650] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:48 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:48.733432 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-31a1be7d-00a6-4ac6-84d8-8035d0896250 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:48.734107 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-31a1be7d-00a6-4ac6-84d8-8035d0896250 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:48.741119 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-31a1be7d-00a6-4ac6-84d8-8035d0896250 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:48.741595 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-31a1be7d-00a6-4ac6-84d8-8035d0896250 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:48.742405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-31a1be7d-00a6-4ac6-84d8-8035d0896250 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:48.742867 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-31a1be7d-00a6-4ac6-84d8-8035d0896250 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:48.880614 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-31a1be7d-00a6-4ac6-84d8-8035d0896250 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:48.888782 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-31a1be7d-00a6-4ac6-84d8-8035d0896250 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.159496 Jul 11 21:03:48.889387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 328/651] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:48 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:49.293904 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-94bad181-e9f1-4715-b33f-f29426b67277 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:49.294484 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-94bad181-e9f1-4715-b33f-f29426b67277 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:49.297095 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=49 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:49.303889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94bad181-e9f1-4715-b33f-f29426b67277 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:49.304348 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94bad181-e9f1-4715-b33f-f29426b67277 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:49.305105 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94bad181-e9f1-4715-b33f-f29426b67277 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:49.305528 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94bad181-e9f1-4715-b33f-f29426b67277 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:49.456450 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-94bad181-e9f1-4715-b33f-f29426b67277 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:49.468173 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-94bad181-e9f1-4715-b33f-f29426b67277 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.177873 Jul 11 21:03:49.469025 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 324/652] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:49 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:03:49.670471 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-47f7d770-0117-4ff3-972f-1ee5b17068e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:49.671174 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-47f7d770-0117-4ff3-972f-1ee5b17068e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:49.679640 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-47f7d770-0117-4ff3-972f-1ee5b17068e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:49.680479 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-47f7d770-0117-4ff3-972f-1ee5b17068e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:49.681161 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-47f7d770-0117-4ff3-972f-1ee5b17068e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:49.681687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-47f7d770-0117-4ff3-972f-1ee5b17068e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:49.825248 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-47f7d770-0117-4ff3-972f-1ee5b17068e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:49.833317 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-47f7d770-0117-4ff3-972f-1ee5b17068e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.167571 Jul 11 21:03:49.833936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 329/653] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:49 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:49.910497 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-76228e5a-0fc9-420d-b7d3-23cb9a41e2a4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:49.911286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-76228e5a-0fc9-420d-b7d3-23cb9a41e2a4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:49.921683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-76228e5a-0fc9-420d-b7d3-23cb9a41e2a4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:49.922315 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-76228e5a-0fc9-420d-b7d3-23cb9a41e2a4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:49.923581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-76228e5a-0fc9-420d-b7d3-23cb9a41e2a4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:49.924353 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-76228e5a-0fc9-420d-b7d3-23cb9a41e2a4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:50.059114 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-76228e5a-0fc9-420d-b7d3-23cb9a41e2a4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:50.067610 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-76228e5a-0fc9-420d-b7d3-23cb9a41e2a4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.163941 Jul 11 21:03:50.068187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 325/654] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:49 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:50.489923 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fec0d249-1101-4cc1-ab60-d50c9d4f0f0b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:50.490622 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fec0d249-1101-4cc1-ab60-d50c9d4f0f0b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:50.497400 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fec0d249-1101-4cc1-ab60-d50c9d4f0f0b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:50.497875 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fec0d249-1101-4cc1-ab60-d50c9d4f0f0b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:50.498678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fec0d249-1101-4cc1-ab60-d50c9d4f0f0b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:50.499139 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fec0d249-1101-4cc1-ab60-d50c9d4f0f0b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:50.631611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fec0d249-1101-4cc1-ab60-d50c9d4f0f0b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:50.642820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fec0d249-1101-4cc1-ab60-d50c9d4f0f0b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.159074 Jul 11 21:03:50.643560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 330/655] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:50 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:50.852555 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f9a3b50e-e112-4d96-927a-dccae11e2721 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:50.853171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f9a3b50e-e112-4d96-927a-dccae11e2721 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:50.860019 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f9a3b50e-e112-4d96-927a-dccae11e2721 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:50.860509 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f9a3b50e-e112-4d96-927a-dccae11e2721 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:50.861275 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f9a3b50e-e112-4d96-927a-dccae11e2721 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:50.861755 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f9a3b50e-e112-4d96-927a-dccae11e2721 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:51.005573 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f9a3b50e-e112-4d96-927a-dccae11e2721 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:51.013330 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f9a3b50e-e112-4d96-927a-dccae11e2721 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.165478 Jul 11 21:03:51.013914 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 326/656] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:50 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:51.088201 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b7c3e27b-47b8-47c7-8721-0a3098145868 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:51.089042 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b7c3e27b-47b8-47c7-8721-0a3098145868 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:51.098800 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7c3e27b-47b8-47c7-8721-0a3098145868 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:51.099297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7c3e27b-47b8-47c7-8721-0a3098145868 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:51.100051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7c3e27b-47b8-47c7-8721-0a3098145868 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:51.100512 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b7c3e27b-47b8-47c7-8721-0a3098145868 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:51.236301 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b7c3e27b-47b8-47c7-8721-0a3098145868 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:51.245387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b7c3e27b-47b8-47c7-8721-0a3098145868 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1736 microversion: 2.1 time: 0.164145 Jul 11 21:03:51.245979 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 331/657] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:51 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:51.664973 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-69cd8a4c-951a-455b-96cb-ed6c2a21147f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:51.665598 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-69cd8a4c-951a-455b-96cb-ed6c2a21147f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:51.674887 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-69cd8a4c-951a-455b-96cb-ed6c2a21147f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:51.675460 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-69cd8a4c-951a-455b-96cb-ed6c2a21147f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:51.677271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-69cd8a4c-951a-455b-96cb-ed6c2a21147f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:51.677803 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-69cd8a4c-951a-455b-96cb-ed6c2a21147f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:51.821128 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-69cd8a4c-951a-455b-96cb-ed6c2a21147f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:51.828961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-69cd8a4c-951a-455b-96cb-ed6c2a21147f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.170573 Jul 11 21:03:51.829529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 327/658] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:51 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:52.034161 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-796e173b-be2e-4c54-af27-6ddb82f77d3b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:52.034986 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-796e173b-be2e-4c54-af27-6ddb82f77d3b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:52.045746 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-796e173b-be2e-4c54-af27-6ddb82f77d3b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.046484 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-796e173b-be2e-4c54-af27-6ddb82f77d3b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.047791 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-796e173b-be2e-4c54-af27-6ddb82f77d3b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.048556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-796e173b-be2e-4c54-af27-6ddb82f77d3b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.194745 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-796e173b-be2e-4c54-af27-6ddb82f77d3b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:52.202391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-796e173b-be2e-4c54-af27-6ddb82f77d3b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.174825 Jul 11 21:03:52.206832 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 332/659] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:52 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:52.263022 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-dcee69d6-7840-4413-a489-a92fe669e545 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:52.263660 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-dcee69d6-7840-4413-a489-a92fe669e545 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:52.271072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dcee69d6-7840-4413-a489-a92fe669e545 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.271525 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dcee69d6-7840-4413-a489-a92fe669e545 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.272336 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dcee69d6-7840-4413-a489-a92fe669e545 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.272767 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-dcee69d6-7840-4413-a489-a92fe669e545 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.405557 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-dcee69d6-7840-4413-a489-a92fe669e545 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:52.414558 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-dcee69d6-7840-4413-a489-a92fe669e545 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1716 microversion: 2.1 time: 0.155500 Jul 11 21:03:52.415134 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 328/660] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:52 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:52.468846 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:52.469331 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:52.475504 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.475941 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.476721 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.477149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.565827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] HTTP exception thrown: Cannot 'detach_volume' instance 49fff1a4-e60c-436d-b94c-e4e414557cbe while it is in vm_state rescued Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Request method failure captured: Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: DELETE /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments/3631bd83-6dd6-4b13-8c0f-4e2e5428330e HTTP/1.1 Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI62lRWdgL26NSoKvMm26ZR-MIh8lmsoilICwbHhZnefhyhzZZn4QE3yYGVFYUEf6Gb7DhWQjbnLqk-TfBxwd3HjP10g6J39OOhDcjatM8tyLGCx3fY8gZ1ahcVk4eSU13TT33VA4MEvj266VSZq1shx9AlAMKROF46H5Fp0GmVFal4 Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:03:52.567525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6f21a94f61e42c9b967e673f02eb270", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: aa7e6c5842a84e91ac94c1107ad29158 Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:03:52.569122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Cannot 'detach_volume' instance 49fff1a4-e60c-436d-b94c-e4e414557cbe while it is in vm_state rescued Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'server_id': '49fff1a4-e60c-436d-b94c-e4e414557cbe', 'id': '3631bd83-6dd6-4b13-8c0f-4e2e5428330e'} Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 49fff1a4-e60c-436d-b94c-e4e414557cbe in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:03:52.569973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 49fff1a4-e60c-436d-b94c-e4e414557cbe while it is in vm_state rescued Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 49fff1a4-e60c-436d-b94c-e4e414557cbe while it is in vm_state rescued Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:03:52.571434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Returning 409 to user: Cannot 'detach_volume' instance 49fff1a4-e60c-436d-b94c-e4e414557cbe while it is in vm_state rescued {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:03:52.572634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6d67d9ea-f7ec-463a-a39f-1ce0c8e322a3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments/3631bd83-6dd6-4b13-8c0f-4e2e5428330e" status: 409 len: 152 microversion: 2.1 time: 0.104091 Jul 11 21:03:52.572634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 333/661] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:03:52 2022] DELETE /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments/3631bd83-6dd6-4b13-8c0f-4e2e5428330e => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 11 21:03:52.578115 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-da4ee426-39d6-4320-a417-b3e66466eb4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:03:52.578989 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-da4ee426-39d6-4320-a417-b3e66466eb4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:52.585899 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da4ee426-39d6-4320-a417-b3e66466eb4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.586337 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da4ee426-39d6-4320-a417-b3e66466eb4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.587090 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da4ee426-39d6-4320-a417-b3e66466eb4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.587514 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-da4ee426-39d6-4320-a417-b3e66466eb4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.662431 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-da4ee426-39d6-4320-a417-b3e66466eb4c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "POST /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/action" status: 202 len: 0 microversion: 2.1 time: 0.087910 Jul 11 21:03:52.662975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 329/662] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:03:52 2022] POST /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:03:52.671144 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-94dfd2a9-e0fa-4d1e-b82d-077db38d6352 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:52.671757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-94dfd2a9-e0fa-4d1e-b82d-077db38d6352 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:52.678419 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-94dfd2a9-e0fa-4d1e-b82d-077db38d6352 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.678863 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-94dfd2a9-e0fa-4d1e-b82d-077db38d6352 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.679626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-94dfd2a9-e0fa-4d1e-b82d-077db38d6352 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.680083 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-94dfd2a9-e0fa-4d1e-b82d-077db38d6352 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.816754 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-94dfd2a9-e0fa-4d1e-b82d-077db38d6352 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:52.827248 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-94dfd2a9-e0fa-4d1e-b82d-077db38d6352 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1724 microversion: 2.1 time: 0.159922 Jul 11 21:03:52.827822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 334/663] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:52 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:52.847187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cc687a72-b8bd-4e29-a57f-66c3995842bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:52.847913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cc687a72-b8bd-4e29-a57f-66c3995842bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:52.854398 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc687a72-b8bd-4e29-a57f-66c3995842bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.854845 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc687a72-b8bd-4e29-a57f-66c3995842bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.855601 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc687a72-b8bd-4e29-a57f-66c3995842bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:52.856031 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cc687a72-b8bd-4e29-a57f-66c3995842bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:52.993996 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cc687a72-b8bd-4e29-a57f-66c3995842bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:53.001651 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cc687a72-b8bd-4e29-a57f-66c3995842bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.158680 Jul 11 21:03:53.002313 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 330/664] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:52 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:53.219687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ce2a540b-79d1-4e67-aaaa-001176904881 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:53.220381 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ce2a540b-79d1-4e67-aaaa-001176904881 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:53.226870 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ce2a540b-79d1-4e67-aaaa-001176904881 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:53.227609 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ce2a540b-79d1-4e67-aaaa-001176904881 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:53.228399 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ce2a540b-79d1-4e67-aaaa-001176904881 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:53.228826 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ce2a540b-79d1-4e67-aaaa-001176904881 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:53.358059 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ce2a540b-79d1-4e67-aaaa-001176904881 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:53.365803 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ce2a540b-79d1-4e67-aaaa-001176904881 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.150009 Jul 11 21:03:53.366413 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 335/665] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:53 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:53.844423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b385344e-a71a-4757-b001-0599643face4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:53.844937 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-b385344e-a71a-4757-b001-0599643face4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:53.852032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b385344e-a71a-4757-b001-0599643face4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:53.852512 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b385344e-a71a-4757-b001-0599643face4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:53.853271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b385344e-a71a-4757-b001-0599643face4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:53.853734 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b385344e-a71a-4757-b001-0599643face4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:54.019058 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1f3c8bcc-83aa-4291-92d3-9898066cc58e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:54.019724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1f3c8bcc-83aa-4291-92d3-9898066cc58e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:54.026513 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f3c8bcc-83aa-4291-92d3-9898066cc58e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:54.026963 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f3c8bcc-83aa-4291-92d3-9898066cc58e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:54.027735 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f3c8bcc-83aa-4291-92d3-9898066cc58e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:54.028198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f3c8bcc-83aa-4291-92d3-9898066cc58e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:54.078439 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-b385344e-a71a-4757-b001-0599643face4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:54.086943 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b385344e-a71a-4757-b001-0599643face4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1724 microversion: 2.1 time: 0.246452 Jul 11 21:03:54.096798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 331/666] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:53 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:54.165897 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1f3c8bcc-83aa-4291-92d3-9898066cc58e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:54.173607 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1f3c8bcc-83aa-4291-92d3-9898066cc58e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.158548 Jul 11 21:03:54.174148 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 336/667] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:54 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:54.387168 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-79447125-4d90-40cc-b8e2-6d8405c42e0d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:54.388185 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-79447125-4d90-40cc-b8e2-6d8405c42e0d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:54.397329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-79447125-4d90-40cc-b8e2-6d8405c42e0d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:54.397771 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-79447125-4d90-40cc-b8e2-6d8405c42e0d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:54.398553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-79447125-4d90-40cc-b8e2-6d8405c42e0d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:54.398981 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-79447125-4d90-40cc-b8e2-6d8405c42e0d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:54.547476 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-79447125-4d90-40cc-b8e2-6d8405c42e0d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:54.551705 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:54.555990 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-79447125-4d90-40cc-b8e2-6d8405c42e0d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.175281 Jul 11 21:03:54.556581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 332/668] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:54 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:55.105511 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-be383520-c331-43a8-b08e-e75903a49674 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:55.106545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-be383520-c331-43a8-b08e-e75903a49674 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:55.116367 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be383520-c331-43a8-b08e-e75903a49674 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:55.116979 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be383520-c331-43a8-b08e-e75903a49674 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:55.117752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be383520-c331-43a8-b08e-e75903a49674 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:55.118738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be383520-c331-43a8-b08e-e75903a49674 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:55.169582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-9abb80c3-54d6-4a41-b59c-e0442309b70b req-2de4a96b-e652-4012-babd-e0dac37286cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1013294-9d36-4435-8113-260bfdee6c2e", "name": "network-vif-plugged", "status": "completed", "tag": "f2193191-95da-4dac-8666-32647c0fe803"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:03:55.180727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9abb80c3-54d6-4a41-b59c-e0442309b70b req-2de4a96b-e652-4012-babd-e0dac37286cd service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:55.181257 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9abb80c3-54d6-4a41-b59c-e0442309b70b req-2de4a96b-e652-4012-babd-e0dac37286cd service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:55.194032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-9abb80c3-54d6-4a41-b59c-e0442309b70b req-2de4a96b-e652-4012-babd-e0dac37286cd service nova] Creating event network-vif-plugged:f2193191-95da-4dac-8666-32647c0fe803 for instance a1013294-9d36-4435-8113-260bfdee6c2e on hv-cinder-84902 Jul 11 21:03:55.199036 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-9abb80c3-54d6-4a41-b59c-e0442309b70b req-2de4a96b-e652-4012-babd-e0dac37286cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103840 Jul 11 21:03:55.199716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 337/669] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:03:55.205241 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4e47bc55-8dc8-4a90-aa25-68685d8d2272 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:55.205957 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4e47bc55-8dc8-4a90-aa25-68685d8d2272 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:55.213396 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4e47bc55-8dc8-4a90-aa25-68685d8d2272 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:55.213923 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4e47bc55-8dc8-4a90-aa25-68685d8d2272 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:55.214787 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4e47bc55-8dc8-4a90-aa25-68685d8d2272 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:55.215283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4e47bc55-8dc8-4a90-aa25-68685d8d2272 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:55.264225 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-be383520-c331-43a8-b08e-e75903a49674 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:55.272572 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-be383520-c331-43a8-b08e-e75903a49674 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1724 microversion: 2.1 time: 0.171160 Jul 11 21:03:55.273118 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 333/670] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:55 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:03:55.344863 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4e47bc55-8dc8-4a90-aa25-68685d8d2272 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:55.352890 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4e47bc55-8dc8-4a90-aa25-68685d8d2272 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.151940 Jul 11 21:03:55.353454 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 338/671] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:55 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:55.577375 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-530bf39a-5234-42c9-9d60-854586af3e97 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:55.578352 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-530bf39a-5234-42c9-9d60-854586af3e97 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:55.589213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-530bf39a-5234-42c9-9d60-854586af3e97 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:55.589955 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-530bf39a-5234-42c9-9d60-854586af3e97 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:55.591203 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-530bf39a-5234-42c9-9d60-854586af3e97 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:55.591914 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-530bf39a-5234-42c9-9d60-854586af3e97 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:55.735237 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-530bf39a-5234-42c9-9d60-854586af3e97 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:55.744439 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-530bf39a-5234-42c9-9d60-854586af3e97 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.173558 Jul 11 21:03:55.745017 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 334/672] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:55 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:56.291130 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1fb869b1-8019-4337-b3e5-0485ceef0da4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:56.291702 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1fb869b1-8019-4337-b3e5-0485ceef0da4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:56.298531 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1fb869b1-8019-4337-b3e5-0485ceef0da4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:56.298977 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1fb869b1-8019-4337-b3e5-0485ceef0da4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:56.299739 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1fb869b1-8019-4337-b3e5-0485ceef0da4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:56.300168 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1fb869b1-8019-4337-b3e5-0485ceef0da4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:56.319702 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:56.374980 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1388cedb-3451-452b-b1a1-0e9b77d2a61f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:56.375618 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1388cedb-3451-452b-b1a1-0e9b77d2a61f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:56.382927 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1388cedb-3451-452b-b1a1-0e9b77d2a61f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:56.383377 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1388cedb-3451-452b-b1a1-0e9b77d2a61f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:56.384152 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1388cedb-3451-452b-b1a1-0e9b77d2a61f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:56.384585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1388cedb-3451-452b-b1a1-0e9b77d2a61f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:56.446479 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1fb869b1-8019-4337-b3e5-0485ceef0da4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:56.454600 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1fb869b1-8019-4337-b3e5-0485ceef0da4 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1724 microversion: 2.1 time: 0.167437 Jul 11 21:03:56.455177 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 339/673] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:56 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:56.530944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1388cedb-3451-452b-b1a1-0e9b77d2a61f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:56.542089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1388cedb-3451-452b-b1a1-0e9b77d2a61f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.175510 Jul 11 21:03:56.542825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 335/674] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:56 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:56.763529 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-30c54c84-2640-44b8-a70e-4733c8248b24 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:56.764289 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-30c54c84-2640-44b8-a70e-4733c8248b24 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:56.771187 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30c54c84-2640-44b8-a70e-4733c8248b24 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:56.771703 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30c54c84-2640-44b8-a70e-4733c8248b24 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:56.772548 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30c54c84-2640-44b8-a70e-4733c8248b24 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:56.772971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30c54c84-2640-44b8-a70e-4733c8248b24 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:56.913341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-30c54c84-2640-44b8-a70e-4733c8248b24 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:56.920922 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-30c54c84-2640-44b8-a70e-4733c8248b24 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.162921 Jul 11 21:03:56.921479 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 340/675] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:56 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:57.475609 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-be082c43-237b-48af-a22e-6978c0a89803 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:57.476703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-be082c43-237b-48af-a22e-6978c0a89803 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:57.487566 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be082c43-237b-48af-a22e-6978c0a89803 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:57.488435 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be082c43-237b-48af-a22e-6978c0a89803 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:57.489181 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be082c43-237b-48af-a22e-6978c0a89803 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:57.489602 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be082c43-237b-48af-a22e-6978c0a89803 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:57.562876 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d210d7ec-6b9b-4ac8-83c6-691befa0fbf5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:57.563445 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d210d7ec-6b9b-4ac8-83c6-691befa0fbf5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:57.565356 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:03:57.571351 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d210d7ec-6b9b-4ac8-83c6-691befa0fbf5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:57.571874 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d210d7ec-6b9b-4ac8-83c6-691befa0fbf5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:57.572739 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d210d7ec-6b9b-4ac8-83c6-691befa0fbf5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:57.573234 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d210d7ec-6b9b-4ac8-83c6-691befa0fbf5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:57.622150 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-be082c43-237b-48af-a22e-6978c0a89803 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:57.630210 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-be082c43-237b-48af-a22e-6978c0a89803 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1730 microversion: 2.1 time: 0.161242 Jul 11 21:03:57.630763 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 336/676] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:57 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:57.648247 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c6410336-5edf-4a64-a4b0-489b7ea8f4e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:57.648740 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c6410336-5edf-4a64-a4b0-489b7ea8f4e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:57.654689 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c6410336-5edf-4a64-a4b0-489b7ea8f4e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:57.655125 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c6410336-5edf-4a64-a4b0-489b7ea8f4e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:57.655881 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c6410336-5edf-4a64-a4b0-489b7ea8f4e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:57.656341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c6410336-5edf-4a64-a4b0-489b7ea8f4e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:57.709178 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d210d7ec-6b9b-4ac8-83c6-691befa0fbf5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:57.717208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d210d7ec-6b9b-4ac8-83c6-691befa0fbf5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.158293 Jul 11 21:03:57.717775 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 341/677] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:57 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:57.733372 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c6410336-5edf-4a64-a4b0-489b7ea8f4e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089298 Jul 11 21:03:57.733975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 337/678] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jul 11 21:03:57 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:03:57.938550 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4c555612-c0fa-4d01-a426-a3a1e5750d0b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:57.939157 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-4c555612-c0fa-4d01-a426-a3a1e5750d0b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:57.946017 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4c555612-c0fa-4d01-a426-a3a1e5750d0b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:57.947045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4c555612-c0fa-4d01-a426-a3a1e5750d0b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:57.947984 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4c555612-c0fa-4d01-a426-a3a1e5750d0b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:57.948598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-4c555612-c0fa-4d01-a426-a3a1e5750d0b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:58.083650 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-4c555612-c0fa-4d01-a426-a3a1e5750d0b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:58.091689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4c555612-c0fa-4d01-a426-a3a1e5750d0b tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.157264 Jul 11 21:03:58.092385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 342/679] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:57 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:58.669240 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-fd713c49-278d-434b-9211-84fe23ef9c2c req-f6c82149-d2e5-4703-9cea-6de2d07bf7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fff1a4-e60c-436d-b94c-e4e414557cbe", "tag": "6b32af85-d1d7-4e52-9152-d26b348afac0"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:03:58.682069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-fd713c49-278d-434b-9211-84fe23ef9c2c req-f6c82149-d2e5-4703-9cea-6de2d07bf7f2 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:58.682507 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-fd713c49-278d-434b-9211-84fe23ef9c2c req-f6c82149-d2e5-4703-9cea-6de2d07bf7f2 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:58.694493 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-fd713c49-278d-434b-9211-84fe23ef9c2c req-f6c82149-d2e5-4703-9cea-6de2d07bf7f2 service nova] Creating event network-changed:6b32af85-d1d7-4e52-9152-d26b348afac0 for instance 49fff1a4-e60c-436d-b94c-e4e414557cbe on hv-cinder-84902 Jul 11 21:03:58.699589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-fd713c49-278d-434b-9211-84fe23ef9c2c req-f6c82149-d2e5-4703-9cea-6de2d07bf7f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034554 Jul 11 21:03:58.700176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 338/680] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:03:58.734889 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8470b89b-3251-4126-8607-206005e967a0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:58.735446 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8470b89b-3251-4126-8607-206005e967a0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:58.742482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8470b89b-3251-4126-8607-206005e967a0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:58.742927 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8470b89b-3251-4126-8607-206005e967a0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:58.743696 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8470b89b-3251-4126-8607-206005e967a0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:58.744138 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8470b89b-3251-4126-8607-206005e967a0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:58.883401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8470b89b-3251-4126-8607-206005e967a0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:58.891578 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8470b89b-3251-4126-8607-206005e967a0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.160466 Jul 11 21:03:58.892349 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 343/681] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:58 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:59.109670 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e7cf7d22-41a4-440f-bf81-27c6a9c7c239 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:59.110395 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e7cf7d22-41a4-440f-bf81-27c6a9c7c239 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:59.117881 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e7cf7d22-41a4-440f-bf81-27c6a9c7c239 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:59.118345 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e7cf7d22-41a4-440f-bf81-27c6a9c7c239 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:59.119125 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e7cf7d22-41a4-440f-bf81-27c6a9c7c239 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:59.119557 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e7cf7d22-41a4-440f-bf81-27c6a9c7c239 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:59.263587 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e7cf7d22-41a4-440f-bf81-27c6a9c7c239 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:03:59.272223 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e7cf7d22-41a4-440f-bf81-27c6a9c7c239 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1358 microversion: 2.1 time: 0.166735 Jul 11 21:03:59.273206 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 339/682] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:59 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:03:59.908803 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5c55a1cb-236a-4a93-a96e-bdbd871fa56a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:03:59.909367 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5c55a1cb-236a-4a93-a96e-bdbd871fa56a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:03:59.915952 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c55a1cb-236a-4a93-a96e-bdbd871fa56a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:59.916435 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c55a1cb-236a-4a93-a96e-bdbd871fa56a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:03:59.917195 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c55a1cb-236a-4a93-a96e-bdbd871fa56a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:03:59.917620 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c55a1cb-236a-4a93-a96e-bdbd871fa56a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:00.293320 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7927577c-1f01-47d8-8d4f-54c43c93946a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:00.294014 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7927577c-1f01-47d8-8d4f-54c43c93946a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:00.294255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5c55a1cb-236a-4a93-a96e-bdbd871fa56a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:00.302753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7927577c-1f01-47d8-8d4f-54c43c93946a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:00.303191 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7927577c-1f01-47d8-8d4f-54c43c93946a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:00.303949 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7927577c-1f01-47d8-8d4f-54c43c93946a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:00.304317 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5c55a1cb-236a-4a93-a96e-bdbd871fa56a tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.399317 Jul 11 21:04:00.304420 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7927577c-1f01-47d8-8d4f-54c43c93946a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:00.304937 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 344/683] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:03:59 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:00.459825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7927577c-1f01-47d8-8d4f-54c43c93946a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:00.467753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7927577c-1f01-47d8-8d4f-54c43c93946a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1548 microversion: 2.1 time: 0.180695 Jul 11 21:04:00.468364 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 340/684] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:00 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:00.484343 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-26631749-6f98-4462-81ea-f5750093a774 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:00.484948 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-26631749-6f98-4462-81ea-f5750093a774 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:00.492152 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-26631749-6f98-4462-81ea-f5750093a774 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:00.492634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-26631749-6f98-4462-81ea-f5750093a774 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:00.493399 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-26631749-6f98-4462-81ea-f5750093a774 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:00.493829 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-26631749-6f98-4462-81ea-f5750093a774 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:00.632691 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-26631749-6f98-4462-81ea-f5750093a774 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:00.640777 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-26631749-6f98-4462-81ea-f5750093a774 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1548 microversion: 2.1 time: 0.160371 Jul 11 21:04:00.641353 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 345/685] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:00 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:00.656812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6d38e84e-c6cb-4bf4-9a93-1f6e5247c413 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:00.660490 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6d38e84e-c6cb-4bf4-9a93-1f6e5247c413 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:00.661363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6d38e84e-c6cb-4bf4-9a93-1f6e5247c413 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Searching by: {'deleted': False, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e'} {{(pid=118014) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 11 21:04:00.668601 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6d38e84e-c6cb-4bf4-9a93-1f6e5247c413 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:00.669048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6d38e84e-c6cb-4bf4-9a93-1f6e5247c413 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:00.669841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6d38e84e-c6cb-4bf4-9a93-1f6e5247c413 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:00.670274 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6d38e84e-c6cb-4bf4-9a93-1f6e5247c413 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:00.713822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-498ee000-539f-4543-9ba3-af633d333cd8 req-93efd468-935d-4f2e-aa63-66ab286a9855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fff1a4-e60c-436d-b94c-e4e414557cbe", "tag": "6b32af85-d1d7-4e52-9152-d26b348afac0"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:00.722552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-498ee000-539f-4543-9ba3-af633d333cd8 req-93efd468-935d-4f2e-aa63-66ab286a9855 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:00.723020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-498ee000-539f-4543-9ba3-af633d333cd8 req-93efd468-935d-4f2e-aa63-66ab286a9855 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:00.734598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-498ee000-539f-4543-9ba3-af633d333cd8 req-93efd468-935d-4f2e-aa63-66ab286a9855 service nova] Creating event network-changed:6b32af85-d1d7-4e52-9152-d26b348afac0 for instance 49fff1a4-e60c-436d-b94c-e4e414557cbe on hv-cinder-84902 Jul 11 21:04:00.740165 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-498ee000-539f-4543-9ba3-af633d333cd8 req-93efd468-935d-4f2e-aa63-66ab286a9855 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029899 Jul 11 21:04:00.740850 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 346/686] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:00.762766 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.multi_cell_list [None req-6d38e84e-c6cb-4bf4-9a93-1f6e5247c413 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118014) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 11 21:04:00.856824 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6d38e84e-c6cb-4bf4-9a93-1f6e5247c413 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203258 Jul 11 21:04:00.857079 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 341/687] 10.222.0.20 () {58 vars in 1124 bytes} [Mon Jul 11 21:04:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:00.867934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6373f282-68b6-472e-ad6e-cdcd0a3cb55e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:00.868801 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6373f282-68b6-472e-ad6e-cdcd0a3cb55e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:00.875054 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6373f282-68b6-472e-ad6e-cdcd0a3cb55e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:00.875484 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6373f282-68b6-472e-ad6e-cdcd0a3cb55e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:00.876313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6373f282-68b6-472e-ad6e-cdcd0a3cb55e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:00.876742 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6373f282-68b6-472e-ad6e-cdcd0a3cb55e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:01.030146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6373f282-68b6-472e-ad6e-cdcd0a3cb55e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:01.038494 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6373f282-68b6-472e-ad6e-cdcd0a3cb55e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1548 microversion: 2.1 time: 0.174638 Jul 11 21:04:01.039072 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 347/688] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:00 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:01.322589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fbf23a25-c89f-413f-84bb-b2a28ea57946 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:01.324407 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fbf23a25-c89f-413f-84bb-b2a28ea57946 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:01.333404 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbf23a25-c89f-413f-84bb-b2a28ea57946 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:01.334062 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbf23a25-c89f-413f-84bb-b2a28ea57946 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:01.337686 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbf23a25-c89f-413f-84bb-b2a28ea57946 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:01.338267 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbf23a25-c89f-413f-84bb-b2a28ea57946 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:01.570159 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fbf23a25-c89f-413f-84bb-b2a28ea57946 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:01.578140 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fbf23a25-c89f-413f-84bb-b2a28ea57946 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.259502 Jul 11 21:04:01.578728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 342/689] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:01 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:02.594737 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-abded1b6-0f25-47f2-a868-d67f78188b96 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:02.595324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-abded1b6-0f25-47f2-a868-d67f78188b96 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:02.598140 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8a2144e4-4e5a-4f31-8c2e-11b00094697d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca1ee919-abd2-4221-b952-af981b0adec2"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:02.599209 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8a2144e4-4e5a-4f31-8c2e-11b00094697d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:02.602137 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-abded1b6-0f25-47f2-a868-d67f78188b96 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:02.602577 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-abded1b6-0f25-47f2-a868-d67f78188b96 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:02.603380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-abded1b6-0f25-47f2-a868-d67f78188b96 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:02.603797 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-abded1b6-0f25-47f2-a868-d67f78188b96 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:02.605836 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8a2144e4-4e5a-4f31-8c2e-11b00094697d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:02.606279 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8a2144e4-4e5a-4f31-8c2e-11b00094697d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:02.607045 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8a2144e4-4e5a-4f31-8c2e-11b00094697d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:02.607495 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8a2144e4-4e5a-4f31-8c2e-11b00094697d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:02.741003 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-abded1b6-0f25-47f2-a868-d67f78188b96 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:02.748807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-abded1b6-0f25-47f2-a868-d67f78188b96 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.157938 Jul 11 21:04:02.749426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 348/690] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:02 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:02.885951 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8a2144e4-4e5a-4f31-8c2e-11b00094697d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "POST /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291767 Jul 11 21:04:02.886571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 343/691] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:04:02 2022] POST /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:03.767757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-84b7c39a-4b29-4825-97c2-f62801fc3423 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:03.768375 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-84b7c39a-4b29-4825-97c2-f62801fc3423 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:03.775304 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-84b7c39a-4b29-4825-97c2-f62801fc3423 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:03.775757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-84b7c39a-4b29-4825-97c2-f62801fc3423 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:03.776552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-84b7c39a-4b29-4825-97c2-f62801fc3423 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:03.776984 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-84b7c39a-4b29-4825-97c2-f62801fc3423 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:03.909165 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-84b7c39a-4b29-4825-97c2-f62801fc3423 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:03.916929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-84b7c39a-4b29-4825-97c2-f62801fc3423 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1676 microversion: 2.1 time: 0.153211 Jul 11 21:04:03.917495 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 349/692] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:03 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:04.935309 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fbdcf221-e4cf-4568-8543-b117f44da98f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:04.936000 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fbdcf221-e4cf-4568-8543-b117f44da98f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:04.942598 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbdcf221-e4cf-4568-8543-b117f44da98f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:04.943016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbdcf221-e4cf-4568-8543-b117f44da98f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:04.944015 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbdcf221-e4cf-4568-8543-b117f44da98f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:04.944471 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbdcf221-e4cf-4568-8543-b117f44da98f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:05.086164 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fbdcf221-e4cf-4568-8543-b117f44da98f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:05.093798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fbdcf221-e4cf-4568-8543-b117f44da98f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1653 microversion: 2.1 time: 0.163320 Jul 11 21:04:05.094371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 344/693] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:04 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:05.110835 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fb4edb80-2639-4abf-9cbc-dac02ec13a09 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:05.117422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fb4edb80-2639-4abf-9cbc-dac02ec13a09 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:05.118042 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fb4edb80-2639-4abf-9cbc-dac02ec13a09 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:05.140895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fb4edb80-2639-4abf-9cbc-dac02ec13a09 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Going to try to start instance {{(pid=118013) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 11 21:04:05.171123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-802e8549-1164-441a-9690-a847ebc1444c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:05.171794 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-802e8549-1164-441a-9690-a847ebc1444c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:05.178865 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-802e8549-1164-441a-9690-a847ebc1444c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:05.179317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-802e8549-1164-441a-9690-a847ebc1444c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:05.180130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-802e8549-1164-441a-9690-a847ebc1444c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:05.180736 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-802e8549-1164-441a-9690-a847ebc1444c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:05.185374 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fb4edb80-2639-4abf-9cbc-dac02ec13a09 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/action" status: 202 len: 0 microversion: 2.1 time: 0.078165 Jul 11 21:04:05.185990 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 350/694] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:04:05 2022] POST /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 21:04:05.195248 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-11c80496-eb67-407a-9e0f-deb1b6dd95f7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:05.195950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-11c80496-eb67-407a-9e0f-deb1b6dd95f7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:05.202371 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-11c80496-eb67-407a-9e0f-deb1b6dd95f7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:05.202850 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-11c80496-eb67-407a-9e0f-deb1b6dd95f7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:05.203685 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-11c80496-eb67-407a-9e0f-deb1b6dd95f7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:05.204138 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-11c80496-eb67-407a-9e0f-deb1b6dd95f7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:05.319955 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-802e8549-1164-441a-9690-a847ebc1444c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:05.329039 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-802e8549-1164-441a-9690-a847ebc1444c tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1594 microversion: 2.1 time: 0.161944 Jul 11 21:04:05.330330 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 345/695] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:05 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1594 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:05.343951 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-11c80496-eb67-407a-9e0f-deb1b6dd95f7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:05.352233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-11c80496-eb67-407a-9e0f-deb1b6dd95f7 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1662 microversion: 2.1 time: 0.161153 Jul 11 21:04:05.352835 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 351/696] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:05 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:04:06.370281 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-593fa353-dfe4-4aa1-8261-f0d7fac310d5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:06.371251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-593fa353-dfe4-4aa1-8261-f0d7fac310d5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:06.378693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-593fa353-dfe4-4aa1-8261-f0d7fac310d5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:06.379499 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-593fa353-dfe4-4aa1-8261-f0d7fac310d5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:06.380391 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-593fa353-dfe4-4aa1-8261-f0d7fac310d5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:06.380893 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-593fa353-dfe4-4aa1-8261-f0d7fac310d5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:06.530577 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-593fa353-dfe4-4aa1-8261-f0d7fac310d5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:06.539200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-593fa353-dfe4-4aa1-8261-f0d7fac310d5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1662 microversion: 2.1 time: 0.172776 Jul 11 21:04:06.539881 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 346/697] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:06 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1662 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:07.010369 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-37cc846f-ef37-4c65-bf0c-023a4b02a3e2 req-361fc3ed-d11d-4292-9f87-9765a857a718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1013294-9d36-4435-8113-260bfdee6c2e", "tag": "f2193191-95da-4dac-8666-32647c0fe803"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:07.023257 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-37cc846f-ef37-4c65-bf0c-023a4b02a3e2 req-361fc3ed-d11d-4292-9f87-9765a857a718 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:07.023756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-37cc846f-ef37-4c65-bf0c-023a4b02a3e2 req-361fc3ed-d11d-4292-9f87-9765a857a718 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:07.040645 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-37cc846f-ef37-4c65-bf0c-023a4b02a3e2 req-361fc3ed-d11d-4292-9f87-9765a857a718 service nova] Creating event network-changed:f2193191-95da-4dac-8666-32647c0fe803 for instance a1013294-9d36-4435-8113-260bfdee6c2e on hv-cinder-84902 Jul 11 21:04:07.046382 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-37cc846f-ef37-4c65-bf0c-023a4b02a3e2 req-361fc3ed-d11d-4292-9f87-9765a857a718 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106843 Jul 11 21:04:07.047175 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 352/698] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:07.558776 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cd1dc366-b9b7-434d-8034-20d966c66cae tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:07.559638 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cd1dc366-b9b7-434d-8034-20d966c66cae tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:07.566842 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cd1dc366-b9b7-434d-8034-20d966c66cae tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:07.567447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cd1dc366-b9b7-434d-8034-20d966c66cae tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:07.568251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cd1dc366-b9b7-434d-8034-20d966c66cae tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:07.568682 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cd1dc366-b9b7-434d-8034-20d966c66cae tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:07.810666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cd1dc366-b9b7-434d-8034-20d966c66cae tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:07.820121 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cd1dc366-b9b7-434d-8034-20d966c66cae tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1666 microversion: 2.1 time: 0.266013 Jul 11 21:04:07.832563 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 347/699] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:07 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1666 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:08.255428 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-504012f8-37aa-4d5e-b648-1c9261e2c5e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1300502349"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:08.256045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-504012f8-37aa-4d5e-b648-1c9261e2c5e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:08.262771 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-504012f8-37aa-4d5e-b648-1c9261e2c5e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:08.263222 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-504012f8-37aa-4d5e-b648-1c9261e2c5e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:08.263980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-504012f8-37aa-4d5e-b648-1c9261e2c5e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:08.264449 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-504012f8-37aa-4d5e-b648-1c9261e2c5e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:08.399893 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.network.security_group_api [None req-504012f8-37aa-4d5e-b648-1c9261e2c5e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Adding security group d6726e58-642c-4be1-aaef-ec5a328910d5 to port f2193191-95da-4dac-8666-32647c0fe803 Jul 11 21:04:08.776493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-504012f8-37aa-4d5e-b648-1c9261e2c5e4 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "POST /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/action" status: 202 len: 0 microversion: 2.1 time: 0.526739 Jul 11 21:04:08.781546 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 353/700] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:04:08 2022] POST /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:04:08.788781 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-39b68c0b-283a-451c-aded-d192060e9fcc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:08.790159 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-39b68c0b-283a-451c-aded-d192060e9fcc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:08.797551 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-39b68c0b-283a-451c-aded-d192060e9fcc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:08.798569 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-39b68c0b-283a-451c-aded-d192060e9fcc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:08.799508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-39b68c0b-283a-451c-aded-d192060e9fcc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:08.800702 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-39b68c0b-283a-451c-aded-d192060e9fcc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:08.967902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-39b68c0b-283a-451c-aded-d192060e9fcc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:08.971624 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:08.977286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-39b68c0b-283a-451c-aded-d192060e9fcc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1760 microversion: 2.1 time: 0.194092 Jul 11 21:04:08.977857 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 348/701] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:08 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1760 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:09.063113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-b8d380c3-26e4-4beb-a17d-820ad135362c req-d8e10de4-9a1c-4bf1-bde8-c76b32c64507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1013294-9d36-4435-8113-260bfdee6c2e", "tag": "f2193191-95da-4dac-8666-32647c0fe803"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:09.071798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b8d380c3-26e4-4beb-a17d-820ad135362c req-d8e10de4-9a1c-4bf1-bde8-c76b32c64507 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:09.072277 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b8d380c3-26e4-4beb-a17d-820ad135362c req-d8e10de4-9a1c-4bf1-bde8-c76b32c64507 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:09.083792 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-b8d380c3-26e4-4beb-a17d-820ad135362c req-d8e10de4-9a1c-4bf1-bde8-c76b32c64507 service nova] Creating event network-changed:f2193191-95da-4dac-8666-32647c0fe803 for instance a1013294-9d36-4435-8113-260bfdee6c2e on hv-cinder-84902 Jul 11 21:04:09.088784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-b8d380c3-26e4-4beb-a17d-820ad135362c req-d8e10de4-9a1c-4bf1-bde8-c76b32c64507 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029392 Jul 11 21:04:09.089346 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 354/702] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:10.983041 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:04:10.983968 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Mon Jul 11 21:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:04:20.976475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9980b449-5b17-4582-b80d-47b39ef7f2c3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:20.977134 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9980b449-5b17-4582-b80d-47b39ef7f2c3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:20.979282 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:20.980042 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=49 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:20.986791 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9980b449-5b17-4582-b80d-47b39ef7f2c3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:20.987224 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9980b449-5b17-4582-b80d-47b39ef7f2c3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:20.987970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9980b449-5b17-4582-b80d-47b39ef7f2c3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:20.988416 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9980b449-5b17-4582-b80d-47b39ef7f2c3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:21.017933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9980b449-5b17-4582-b80d-47b39ef7f2c3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments/6bcd121b-e329-403b-b797-a25fdbcec2ee" status: 200 len: 194 microversion: 2.20 time: 0.048703 Jul 11 21:04:21.018494 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 349/703] 10.222.0.20 () {60 vars in 1453 bytes} [Mon Jul 11 21:04:20 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments/6bcd121b-e329-403b-b797-a25fdbcec2ee => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 21:04:21.079650 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=27 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:21.080506 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:21.085576 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5239c63f-c316-4a47-8d6c-5e57fc71aa68 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:21.086087 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5239c63f-c316-4a47-8d6c-5e57fc71aa68 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:21.094110 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5239c63f-c316-4a47-8d6c-5e57fc71aa68 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:21.094557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5239c63f-c316-4a47-8d6c-5e57fc71aa68 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:21.095317 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5239c63f-c316-4a47-8d6c-5e57fc71aa68 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:21.095748 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5239c63f-c316-4a47-8d6c-5e57fc71aa68 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:21.187521 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-5239c63f-c316-4a47-8d6c-5e57fc71aa68 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lazy-loading 'services' on Instance uuid 1536f24e-dc7b-4eaf-9b73-32205dbca872 {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:04:21.261317 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5239c63f-c316-4a47-8d6c-5e57fc71aa68 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments/6bcd121b-e329-403b-b797-a25fdbcec2ee" status: 202 len: 0 microversion: 2.20 time: 0.182653 Jul 11 21:04:21.262316 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 355/704] 10.222.0.20 () {60 vars in 1456 bytes} [Mon Jul 11 21:04:21 2022] DELETE /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments/6bcd121b-e329-403b-b797-a25fdbcec2ee => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:04:21.270869 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d83d4990-883b-4577-9675-72a8ffbae12d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:21.272129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d83d4990-883b-4577-9675-72a8ffbae12d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:21.278529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d83d4990-883b-4577-9675-72a8ffbae12d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:21.278973 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d83d4990-883b-4577-9675-72a8ffbae12d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:21.279751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d83d4990-883b-4577-9675-72a8ffbae12d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:21.280293 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d83d4990-883b-4577-9675-72a8ffbae12d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:21.312710 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d83d4990-883b-4577-9675-72a8ffbae12d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045392 Jul 11 21:04:21.313283 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 350/705] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jul 11 21:04:21 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 21:04:22.330390 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a54f4cae-9a0b-42b3-86e9-7a28e90cfbab tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:22.332093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a54f4cae-9a0b-42b3-86e9-7a28e90cfbab tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:22.339881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a54f4cae-9a0b-42b3-86e9-7a28e90cfbab tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:22.340351 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a54f4cae-9a0b-42b3-86e9-7a28e90cfbab tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:22.341117 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a54f4cae-9a0b-42b3-86e9-7a28e90cfbab tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:22.341546 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a54f4cae-9a0b-42b3-86e9-7a28e90cfbab tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:22.370969 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a54f4cae-9a0b-42b3-86e9-7a28e90cfbab tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048056 Jul 11 21:04:22.371450 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 356/706] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jul 11 21:04:22 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 21:04:23.383248 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-aea42b9b-1568-4d14-8828-06e1260c5dd2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:23.384140 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-aea42b9b-1568-4d14-8828-06e1260c5dd2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:23.391062 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aea42b9b-1568-4d14-8828-06e1260c5dd2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:23.391507 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aea42b9b-1568-4d14-8828-06e1260c5dd2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:23.392290 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aea42b9b-1568-4d14-8828-06e1260c5dd2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:23.392714 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aea42b9b-1568-4d14-8828-06e1260c5dd2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:23.422266 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-aea42b9b-1568-4d14-8828-06e1260c5dd2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043165 Jul 11 21:04:23.422828 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 351/707] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jul 11 21:04:23 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:23.480851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fae9ac66-c796-4ff4-bd85-8d523d9128fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:23.481362 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fae9ac66-c796-4ff4-bd85-8d523d9128fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:23.487447 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fae9ac66-c796-4ff4-bd85-8d523d9128fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:23.487893 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fae9ac66-c796-4ff4-bd85-8d523d9128fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:23.488677 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fae9ac66-c796-4ff4-bd85-8d523d9128fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:23.489111 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fae9ac66-c796-4ff4-bd85-8d523d9128fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:23.515206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fae9ac66-c796-4ff4-bd85-8d523d9128fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:04:23.593872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fae9ac66-c796-4ff4-bd85-8d523d9128fd tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 204 len: 0 microversion: 2.20 time: 0.116601 Jul 11 21:04:23.594499 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 357/708] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jul 11 21:04:23 2022] DELETE /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 21:04:23.603134 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:23.603735 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:23.609808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:23.610256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:23.611020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:23.611449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:23.747876 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:23.755862 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:23.757556 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:23.758738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fe5b3cbb-5df3-46b6-9b5d-6d44391ef528 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.159681 Jul 11 21:04:23.759317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 352/709] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:23 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:24.784950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:24.786080 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:24.797272 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:24.798020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:24.799282 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:24.800381 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:24.955504 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:24.967705 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:24.969588 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:24.971268 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a3acfb2c-d8cc-47ae-9ba5-c0d5fe7d6a70 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.193583 Jul 11 21:04:24.972023 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 358/710] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:24 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:25.990359 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:25.990920 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:25.998096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:25.998543 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:25.999311 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:25.999742 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:26.273689 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:26.281949 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:26.283469 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:26.284655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7a4df765-cdf4-4942-bf0c-dc8f8c159a2a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1725 microversion: 2.20 time: 0.298305 Jul 11 21:04:26.285214 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 353/711] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:25 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1725 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:26.813879 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-bf13f487-541c-41ca-879c-a5c5a394b218 req-b3502725-2b47-403d-a395-c0b3715e86aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1536f24e-dc7b-4eaf-9b73-32205dbca872", "name": "network-vif-deleted", "tag": "6878cb2c-c95a-44b5-8449-0da5fe06d309"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:26.826504 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-bf13f487-541c-41ca-879c-a5c5a394b218 req-b3502725-2b47-403d-a395-c0b3715e86aa service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:26.827057 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-bf13f487-541c-41ca-879c-a5c5a394b218 req-b3502725-2b47-403d-a395-c0b3715e86aa service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:26.841924 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-bf13f487-541c-41ca-879c-a5c5a394b218 req-b3502725-2b47-403d-a395-c0b3715e86aa service nova] Creating event network-vif-deleted:6878cb2c-c95a-44b5-8449-0da5fe06d309 for instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 on hv-cinder-84902 Jul 11 21:04:26.849384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-bf13f487-541c-41ca-879c-a5c5a394b218 req-b3502725-2b47-403d-a395-c0b3715e86aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039479 Jul 11 21:04:26.850683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 359/712] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:27.304026 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:27.305500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:27.313649 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:27.314586 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:27.315455 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:27.315885 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:27.359958 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:27.360422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:27.361006 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lazy-loading 'fault' on Instance uuid 1536f24e-dc7b-4eaf-9b73-32205dbca872 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:04:27.403364 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:27.413133 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:27.414722 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:27.416075 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d24fc640-7dd8-4c42-a7e6-fcf7f9467905 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 200 len: 1372 microversion: 2.20 time: 0.117224 Jul 11 21:04:27.416796 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 354/713] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:27 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:28.435762 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:28.436354 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:28.443161 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:28.443599 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:28.444389 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:28.444865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:28.458555 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] HTTP exception thrown: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Request method failure captured: Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 HTTP/1.1 Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI7At3eRhknGlYUgt2zeR7wpPiedO64GVhCUwQISFTc_fzwsgUrTG8aU4Rn0T9K01xqY8v1da4tQMb2W2SBRjf6RzLip1CbYemNCCCrCDwqLEYGVgYoVX_FxZf0GBFDU_soFBKg6mPqD2PYo6nJ-datOvTmebHqxK1kVo-eQcxb2UoY Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:04:28.460240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_570d2b4d5c384612ba17efc8b5bd02ec", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 77cf43c378a9413dbd799a00bfa21eb8 Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:04:28.461940 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '1536f24e-dc7b-4eaf-9b73-32205dbca872'} Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:04:28.466240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:04:28.467678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:28.469024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Returning 404 to user: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:04:28.469024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2883c2f0-d3f8-4ba6-b75d-7de328c17a11 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 404 len: 111 microversion: 2.20 time: 0.030378 Jul 11 21:04:28.469024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 360/714] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:28 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 21:04:28.470665 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-82a72701-51a4-4e56-b5a4-7d4225f6bce8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '.version_select at 0x7f38403873a0>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:28.495542 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-82a72701-51a4-4e56-b5a4-7d4225f6bce8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753453566" status: 204 len: 0 microversion: 2.20 time: 0.028592 Jul 11 21:04:28.496231 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 355/715] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Jul 11 21:04:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753453566 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 21:04:29.409993 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-dff4d3c8-8a92-4217-bdac-df49f494e750 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'create', calling method: .version_select at 0x7f3840318040>, body: {"keypair": {"name": "tempest-keypair-523406216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHXgKgpJWQ1JdbPiU+RarWLrATFb0MvySIfCj2bBrACPwhc/66kQV1cHmNuL4b75J2EufxOKaibtVcP8O+FWyXjV3maFgKyfHth1e4TrZ9bQ/3yiYYAIs2Hnbo2q4u9bw=="}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:29.423916 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-dff4d3c8-8a92-4217-bdac-df49f494e750 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Getting quotas for project 570d2b4d5c384612ba17efc8b5bd02ec. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:04:29.428304 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-dff4d3c8-8a92-4217-bdac-df49f494e750 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Getting quotas for user 77cf43c378a9413dbd799a00bfa21eb8 and project 570d2b4d5c384612ba17efc8b5bd02ec. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:04:29.452249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-dff4d3c8-8a92-4217-bdac-df49f494e750 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046259 Jul 11 21:04:29.452874 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 361/716] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Jul 11 21:04:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 11 21:04:31.001147 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-214600711", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6286643-5950-4434-a797-420c7c45a93b"}], "security_groups": [{"name": "tempest-securitygroup--2074034797"}], "key_name": "tempest-keypair-523406216", "user_data": "}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:31.143684 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] validate_networks() for [('b6286643-5950-4434-a797-420c7c45a93b', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:04:31.653412 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:04:31.654081 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:04:31.654801 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:04:31.655435 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:04:31.656058 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:04:31.667834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:31.668343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:31.669216 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:31.669678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:31.686587 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Getting quotas for project 570d2b4d5c384612ba17efc8b5bd02ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:04:31.690922 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Getting quotas for user 77cf43c378a9413dbd799a00bfa21eb8 and project 570d2b4d5c384612ba17efc8b5bd02ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:04:31.703125 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:04:31.705426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:04:31.756163 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d3d3a77c-1cad-47da-b441-0bfdd53bbc49 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.760008 Jul 11 21:04:31.756854 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 356/717] 10.222.0.20 () {62 vars in 1187 bytes} [Mon Jul 11 21:04:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 11 21:04:31.768258 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d82cdcfe-44e5-4e6e-a4c0-be791ec59406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:31.768964 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d82cdcfe-44e5-4e6e-a4c0-be791ec59406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:31.826180 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d82cdcfe-44e5-4e6e-a4c0-be791ec59406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:31.840618 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d82cdcfe-44e5-4e6e-a4c0-be791ec59406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:31.842581 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d82cdcfe-44e5-4e6e-a4c0-be791ec59406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:31.843730 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d82cdcfe-44e5-4e6e-a4c0-be791ec59406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1280 microversion: 2.20 time: 0.079951 Jul 11 21:04:31.844333 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 362/718] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:31 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:32.863452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:32.864024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:32.870692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:32.871138 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:32.871947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:32.872414 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:32.955440 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:32.966059 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:32.967593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:32.968770 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-23a657b6-817f-483e-b798-4adcf4e82a05 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1340 microversion: 2.20 time: 0.110020 Jul 11 21:04:32.979316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 357/719] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:32 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1340 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:33.987171 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:33.987861 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:33.994924 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:33.995608 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:33.996613 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:33.997234 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:34.128064 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:34.136981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:34.138840 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:34.139599 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7b36a985-ea0f-42a0-a6d9-7c16af1375e1 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1406 microversion: 2.20 time: 0.156504 Jul 11 21:04:34.140225 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 363/720] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:33 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:34.457497 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-09d6d7b0-a185-44a5-bf72-5af88392d116 req-032f1f57-7f11-4075-a3a8-dda039a8ce81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169a98b1-4200-4917-86bd-62e3581530f0", "tag": "744bb15f-623b-4153-b111-d80b7f202ffc"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:34.477366 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-09d6d7b0-a185-44a5-bf72-5af88392d116 req-032f1f57-7f11-4075-a3a8-dda039a8ce81 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:34.477803 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-09d6d7b0-a185-44a5-bf72-5af88392d116 req-032f1f57-7f11-4075-a3a8-dda039a8ce81 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:34.491904 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-09d6d7b0-a185-44a5-bf72-5af88392d116 req-032f1f57-7f11-4075-a3a8-dda039a8ce81 service nova] Creating event network-changed:744bb15f-623b-4153-b111-d80b7f202ffc for instance 169a98b1-4200-4917-86bd-62e3581530f0 on hv-cinder-84902 Jul 11 21:04:34.498743 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-09d6d7b0-a185-44a5-bf72-5af88392d116 req-032f1f57-7f11-4075-a3a8-dda039a8ce81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047820 Jul 11 21:04:34.499655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 358/721] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:35.160645 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:35.161550 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:35.170761 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:35.171322 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:35.172505 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:35.173145 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:35.309695 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:35.318045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:35.319536 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:35.320682 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-13850469-b9ab-458b-bf8b-8d3f3f80b17f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1406 microversion: 2.20 time: 0.166009 Jul 11 21:04:35.321219 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 364/722] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:35 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:36.344333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:36.345476 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:36.355999 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:36.356475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:36.357220 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:36.357658 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:36.502479 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:36.510812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:36.512333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:36.513431 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-40a8b4ef-e7e0-4036-8ee9-bbbbd3802dd4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1406 microversion: 2.20 time: 0.176775 Jul 11 21:04:36.513995 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 359/723] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:36 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:37.535585 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:37.536651 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:37.545341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:37.545789 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:37.546549 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:37.546982 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:37.693090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:37.703417 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:37.705352 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:37.706610 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c4695a5c-3465-4fb9-a079-b089af85c378 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1406 microversion: 2.20 time: 0.177846 Jul 11 21:04:37.707155 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 365/724] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:37 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:38.729160 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:38.730042 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:38.741138 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:38.741854 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:38.743135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:38.743849 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:39.133110 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:39.141426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:39.142896 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:39.143992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bd3a336e-2501-4f32-96e2-f0eefb9bd78e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1406 microversion: 2.20 time: 0.421533 Jul 11 21:04:39.144558 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 360/725] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:38 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:40.167849 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:40.169269 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:40.180047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:40.180874 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:40.182160 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:40.182886 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:40.314325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:40.326302 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:40.328610 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:40.330299 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f240fb03-6561-44d0-aa34-38ed0cca1793 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1406 microversion: 2.20 time: 0.168728 Jul 11 21:04:40.331041 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 366/726] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:40 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:41.349150 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:41.349829 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:41.356715 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:41.357215 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:41.357923 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:41.358353 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:41.377429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-6eda7336-4260-4bf5-b0e5-485de0d20aab req-73629176-12c0-4cd9-8bef-62e411cef673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169a98b1-4200-4917-86bd-62e3581530f0", "name": "network-vif-plugged", "status": "completed", "tag": "744bb15f-623b-4153-b111-d80b7f202ffc"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:41.386670 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-6eda7336-4260-4bf5-b0e5-485de0d20aab req-73629176-12c0-4cd9-8bef-62e411cef673 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:41.387302 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-6eda7336-4260-4bf5-b0e5-485de0d20aab req-73629176-12c0-4cd9-8bef-62e411cef673 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:41.400662 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-6eda7336-4260-4bf5-b0e5-485de0d20aab req-73629176-12c0-4cd9-8bef-62e411cef673 service nova] Creating event network-vif-plugged:744bb15f-623b-4153-b111-d80b7f202ffc for instance 169a98b1-4200-4917-86bd-62e3581530f0 on hv-cinder-84902 Jul 11 21:04:41.406604 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-6eda7336-4260-4bf5-b0e5-485de0d20aab req-73629176-12c0-4cd9-8bef-62e411cef673 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Jul 11 21:04:41.407166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 367/727] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:41.495589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:41.503937 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:41.505468 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:41.506561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c49927b1-b32a-46df-b18e-7671540fb456 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1406 microversion: 2.20 time: 0.161494 Jul 11 21:04:41.507115 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 361/728] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:41 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:42.528654 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:42.529244 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:42.531574 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=6 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:42.537437 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:42.537890 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:42.538657 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:42.539097 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:42.688957 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:42.697280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:42.698778 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:42.699888 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d2e64fff-ac87-4ab9-8ce4-16f86b9d367a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1406 microversion: 2.20 time: 0.178144 Jul 11 21:04:42.700971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 368/729] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:42 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:43.723388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:43.724496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:43.727634 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:43.728976 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:43.736200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:43.736648 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:43.737409 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:43.737837 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:43.873486 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:43.883796 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:43.885858 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:43.887592 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bcc82b5f-733c-497f-98d0-628f0cd06c53 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1598 microversion: 2.20 time: 0.171333 Jul 11 21:04:43.888289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 362/730] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:04:43 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:04:43.905340 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c63ccb22-cc1e-4009-9dd0-cd00a1924af7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:43.905874 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c63ccb22-cc1e-4009-9dd0-cd00a1924af7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:43.911961 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c63ccb22-cc1e-4009-9dd0-cd00a1924af7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:43.912436 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c63ccb22-cc1e-4009-9dd0-cd00a1924af7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:43.913186 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c63ccb22-cc1e-4009-9dd0-cd00a1924af7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:43.913612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c63ccb22-cc1e-4009-9dd0-cd00a1924af7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:43.995122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c63ccb22-cc1e-4009-9dd0-cd00a1924af7 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093771 Jul 11 21:04:43.995740 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 369/731] 10.222.0.20 () {60 vars in 1315 bytes} [Mon Jul 11 21:04:43 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 21:04:45.187179 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-88089647-2fd6-4eab-8d05-49cedf67d40a req-76383aca-f2d9-413a-a713-beed835e15fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169a98b1-4200-4917-86bd-62e3581530f0", "tag": "744bb15f-623b-4153-b111-d80b7f202ffc"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:45.195763 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-88089647-2fd6-4eab-8d05-49cedf67d40a req-76383aca-f2d9-413a-a713-beed835e15fc service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:45.196251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-88089647-2fd6-4eab-8d05-49cedf67d40a req-76383aca-f2d9-413a-a713-beed835e15fc service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:45.207751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-88089647-2fd6-4eab-8d05-49cedf67d40a req-76383aca-f2d9-413a-a713-beed835e15fc service nova] Creating event network-changed:744bb15f-623b-4153-b111-d80b7f202ffc for instance 169a98b1-4200-4917-86bd-62e3581530f0 on hv-cinder-84902 Jul 11 21:04:45.213080 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-88089647-2fd6-4eab-8d05-49cedf67d40a req-76383aca-f2d9-413a-a713-beed835e15fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030131 Jul 11 21:04:45.214208 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 363/732] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:46.784665 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d58c04b9-b858-4848-9448-6037c412f8fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:46.785275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d58c04b9-b858-4848-9448-6037c412f8fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:46.791746 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d58c04b9-b858-4848-9448-6037c412f8fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:46.792212 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d58c04b9-b858-4848-9448-6037c412f8fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:46.792972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d58c04b9-b858-4848-9448-6037c412f8fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:46.793397 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d58c04b9-b858-4848-9448-6037c412f8fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:46.819769 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d58c04b9-b858-4848-9448-6037c412f8fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:04:46.917620 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d58c04b9-b858-4848-9448-6037c412f8fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 204 len: 0 microversion: 2.1 time: 0.138198 Jul 11 21:04:46.918489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 370/733] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:04:46 2022] DELETE /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:04:46.930626 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d7616364-a0ea-4ef2-88f1-6b77366e3df4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:46.931408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d7616364-a0ea-4ef2-88f1-6b77366e3df4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:46.939811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7616364-a0ea-4ef2-88f1-6b77366e3df4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:46.940283 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7616364-a0ea-4ef2-88f1-6b77366e3df4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:46.941037 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7616364-a0ea-4ef2-88f1-6b77366e3df4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:46.941460 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7616364-a0ea-4ef2-88f1-6b77366e3df4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:47.093074 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d7616364-a0ea-4ef2-88f1-6b77366e3df4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:47.101931 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d7616364-a0ea-4ef2-88f1-6b77366e3df4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1576 microversion: 2.1 time: 0.178545 Jul 11 21:04:47.102512 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 364/734] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:46 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:48.125612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-13d81932-70d3-4264-99d6-c3e9dcf619e2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:48.126782 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-13d81932-70d3-4264-99d6-c3e9dcf619e2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:48.138216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13d81932-70d3-4264-99d6-c3e9dcf619e2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:48.138845 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13d81932-70d3-4264-99d6-c3e9dcf619e2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:48.139926 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13d81932-70d3-4264-99d6-c3e9dcf619e2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:48.140377 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-13d81932-70d3-4264-99d6-c3e9dcf619e2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:48.281222 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-13d81932-70d3-4264-99d6-c3e9dcf619e2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:48.286250 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:48.292758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-13d81932-70d3-4264-99d6-c3e9dcf619e2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1576 microversion: 2.1 time: 0.173973 Jul 11 21:04:48.293429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 371/735] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:48 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:49.310160 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fa556f9b-ddd6-471f-965d-31ed2dae1255 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:49.310916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fa556f9b-ddd6-471f-965d-31ed2dae1255 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:49.317641 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fa556f9b-ddd6-471f-965d-31ed2dae1255 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:49.318083 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fa556f9b-ddd6-471f-965d-31ed2dae1255 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:49.318850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fa556f9b-ddd6-471f-965d-31ed2dae1255 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:49.319277 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fa556f9b-ddd6-471f-965d-31ed2dae1255 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:49.543264 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fa556f9b-ddd6-471f-965d-31ed2dae1255 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:49.551783 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fa556f9b-ddd6-471f-965d-31ed2dae1255 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1576 microversion: 2.1 time: 0.245508 Jul 11 21:04:49.552737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 365/736] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:49 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:50.076783 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-b2b7f012-b637-4f7b-acbc-fa8fef9f9dbf req-1d4fd6bc-7df5-432a-a3d1-b69b4754d969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab48eb9-c7dd-477d-9722-c03b4e165059", "name": "network-vif-deleted", "tag": "4eb794cf-2acb-4971-9c22-8e3d115edb88"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:50.088864 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b2b7f012-b637-4f7b-acbc-fa8fef9f9dbf req-1d4fd6bc-7df5-432a-a3d1-b69b4754d969 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:50.089297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b2b7f012-b637-4f7b-acbc-fa8fef9f9dbf req-1d4fd6bc-7df5-432a-a3d1-b69b4754d969 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:50.101656 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-b2b7f012-b637-4f7b-acbc-fa8fef9f9dbf req-1d4fd6bc-7df5-432a-a3d1-b69b4754d969 service nova] Creating event network-vif-deleted:4eb794cf-2acb-4971-9c22-8e3d115edb88 for instance aab48eb9-c7dd-477d-9722-c03b4e165059 on hv-cinder-84902 Jul 11 21:04:50.107200 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-b2b7f012-b637-4f7b-acbc-fa8fef9f9dbf req-1d4fd6bc-7df5-432a-a3d1-b69b4754d969 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034755 Jul 11 21:04:50.108463 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 372/737] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:04:50.569576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:50.570509 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:50.580011 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:50.580767 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:50.581971 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:50.582590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:50.617401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:50.617847 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:50.618322 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lazy-loading 'fault' on Instance uuid aab48eb9-c7dd-477d-9722-c03b4e165059 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:04:50.660944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:50.668917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-36501fab-718e-4fb3-a271-50d462c4919f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 200 len: 1229 microversion: 2.1 time: 0.103789 Jul 11 21:04:50.669510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 366/738] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:50 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:51.688582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:51.689398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:51.691461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:51.697669 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:51.698160 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:51.698993 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:51.699473 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:51.715223 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] HTTP exception thrown: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Request method failure captured: Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 HTTP/1.1 Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI9x4U73Kz35Yd0dee2LV9HDi39yMHQH6659EWPCnABZs3AR-vmF0in5c7nUYlNGbFBLc3TBVOWFN5C7atVV5qxFWrLG3X-K9bw3eaHIN5D-kzOwp63csCuuTUyK7Nn6J92-XIhNnBwXvM3cJH2tOFaGfzA5xsfFzQg4Bgw5ws3uwWI Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:04:51.716847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ed25b82be2043b188d2682a5c01490a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-TestVolumeBootPattern-413949471 Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 5f8c2e5e6c1b4833b0e9af0de8814d13 Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:04:51.718276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'aab48eb9-c7dd-477d-9722-c03b4e165059'} Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:04:51.719093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:04:51.720690 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:04:51.722017 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Returning 404 to user: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:04:51.722017 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1c4c9f10-381a-46df-9d4c-1512575cd41c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 404 len: 111 microversion: 2.1 time: 0.034497 Jul 11 21:04:51.722017 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 373/739] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:51 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:04:51.821728 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1455946297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-538925586", "security_groups": [{"name": "tempest-secgroup-smoke-1512411600"}], "block_device_mapping_v2": [{"uuid": "5f99483d-3163-4461-af30-5e718cfbbcdc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa18e945-a5c1-46c3-85a2-9a904972193b"}]}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:51.830745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:51.939997 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] validate_networks() for [('fa18e945-a5c1-46c3-85a2-9a904972193b', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:04:52.327936 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:04:52.328388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:04:52.328859 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:04:52.329291 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:04:52.329849 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:04:52.339177 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:52.339625 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:52.340456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:52.340893 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:52.346764 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=95 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:52.359796 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Getting quotas for project 6ed25b82be2043b188d2682a5c01490a. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:04:52.364013 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Getting quotas for user 5f8c2e5e6c1b4833b0e9af0de8814d13 and project 6ed25b82be2043b188d2682a5c01490a. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:04:52.425830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:04:52.427946 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f99483d-3163-4461-af30-5e718cfbbcdc',volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:04:52.572581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6cec6491-a6f7-479f-883b-b04a5ed95171 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754699 Jul 11 21:04:52.573227 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 367/740] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:04:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:04:52.583542 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ca3296bb-a51a-4f4f-8578-dafa0cc14920 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:52.584257 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ca3296bb-a51a-4f4f-8578-dafa0cc14920 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:52.639947 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ca3296bb-a51a-4f4f-8578-dafa0cc14920 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:52.647614 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ca3296bb-a51a-4f4f-8578-dafa0cc14920 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1094 microversion: 2.1 time: 0.067728 Jul 11 21:04:52.648232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 374/741] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:52 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:53.665322 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7fb1e987-b553-4a5d-9116-961435dc00a6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:53.665999 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7fb1e987-b553-4a5d-9116-961435dc00a6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:53.672221 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7fb1e987-b553-4a5d-9116-961435dc00a6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:53.672670 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7fb1e987-b553-4a5d-9116-961435dc00a6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:53.673429 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7fb1e987-b553-4a5d-9116-961435dc00a6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:53.673875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7fb1e987-b553-4a5d-9116-961435dc00a6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:53.774634 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7fb1e987-b553-4a5d-9116-961435dc00a6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:53.782933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7fb1e987-b553-4a5d-9116-961435dc00a6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1200 microversion: 2.1 time: 0.122113 Jul 11 21:04:53.784439 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 368/742] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:53 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1200 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:54.800993 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f25fc4cf-ad1b-498b-b186-d985681a1371 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:54.801578 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f25fc4cf-ad1b-498b-b186-d985681a1371 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:54.808019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f25fc4cf-ad1b-498b-b186-d985681a1371 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:54.808503 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f25fc4cf-ad1b-498b-b186-d985681a1371 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:54.809262 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f25fc4cf-ad1b-498b-b186-d985681a1371 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:54.809687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f25fc4cf-ad1b-498b-b186-d985681a1371 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:54.954498 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f25fc4cf-ad1b-498b-b186-d985681a1371 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:54.962961 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f25fc4cf-ad1b-498b-b186-d985681a1371 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.166585 Jul 11 21:04:54.973185 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 375/743] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:54 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:55.124536 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-f833606d-b677-4e5c-b517-73a5b72af8c0 req-2bdb5cb3-5f9e-4bb3-bebd-ddf49d26f06b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ddede4-7286-447e-9b09-947fdc35bcec", "tag": "7ad2ae0e-ff81-4b5a-9775-83301f98f0cc"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:04:55.135418 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-f833606d-b677-4e5c-b517-73a5b72af8c0 req-2bdb5cb3-5f9e-4bb3-bebd-ddf49d26f06b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:55.136353 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-f833606d-b677-4e5c-b517-73a5b72af8c0 req-2bdb5cb3-5f9e-4bb3-bebd-ddf49d26f06b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:55.149321 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-f833606d-b677-4e5c-b517-73a5b72af8c0 req-2bdb5cb3-5f9e-4bb3-bebd-ddf49d26f06b service nova] Creating event network-changed:7ad2ae0e-ff81-4b5a-9775-83301f98f0cc for instance a1ddede4-7286-447e-9b09-947fdc35bcec on hv-cinder-84902 Jul 11 21:04:55.165979 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-f833606d-b677-4e5c-b517-73a5b72af8c0 req-2bdb5cb3-5f9e-4bb3-bebd-ddf49d26f06b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045621 Jul 11 21:04:55.169379 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 369/744] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:04:55.984711 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a7d7ccfc-5445-4c01-ad56-832132a4d74f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:55.985703 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a7d7ccfc-5445-4c01-ad56-832132a4d74f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:55.996477 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a7d7ccfc-5445-4c01-ad56-832132a4d74f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:55.997209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a7d7ccfc-5445-4c01-ad56-832132a4d74f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:55.998467 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a7d7ccfc-5445-4c01-ad56-832132a4d74f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:55.999176 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a7d7ccfc-5445-4c01-ad56-832132a4d74f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:56.145346 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a7d7ccfc-5445-4c01-ad56-832132a4d74f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:56.153311 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a7d7ccfc-5445-4c01-ad56-832132a4d74f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.175307 Jul 11 21:04:56.153881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 376/745] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:55 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:57.171383 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e1916481-cf62-40f1-bce5-a54915d30889 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:57.172054 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e1916481-cf62-40f1-bce5-a54915d30889 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:57.179597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e1916481-cf62-40f1-bce5-a54915d30889 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:57.180044 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e1916481-cf62-40f1-bce5-a54915d30889 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:57.181517 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e1916481-cf62-40f1-bce5-a54915d30889 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:57.181956 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e1916481-cf62-40f1-bce5-a54915d30889 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:57.337216 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e1916481-cf62-40f1-bce5-a54915d30889 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:57.346093 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e1916481-cf62-40f1-bce5-a54915d30889 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.179531 Jul 11 21:04:57.346675 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 370/746] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:57 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:58.370053 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-849ea838-e367-43b3-bb22-a95b092d50c4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:58.370726 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-849ea838-e367-43b3-bb22-a95b092d50c4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:58.378465 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-849ea838-e367-43b3-bb22-a95b092d50c4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:58.379016 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-849ea838-e367-43b3-bb22-a95b092d50c4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:58.380373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-849ea838-e367-43b3-bb22-a95b092d50c4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:58.380888 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-849ea838-e367-43b3-bb22-a95b092d50c4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:58.517662 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-849ea838-e367-43b3-bb22-a95b092d50c4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:58.526031 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-849ea838-e367-43b3-bb22-a95b092d50c4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.161438 Jul 11 21:04:58.526607 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 377/747] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:58 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:04:59.546383 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bfdc826a-ff96-4a93-beec-0be2f0ac1fa2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:04:59.547316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bfdc826a-ff96-4a93-beec-0be2f0ac1fa2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:04:59.557917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bfdc826a-ff96-4a93-beec-0be2f0ac1fa2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:59.558653 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bfdc826a-ff96-4a93-beec-0be2f0ac1fa2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:59.559902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bfdc826a-ff96-4a93-beec-0be2f0ac1fa2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:04:59.560668 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bfdc826a-ff96-4a93-beec-0be2f0ac1fa2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:04:59.704365 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bfdc826a-ff96-4a93-beec-0be2f0ac1fa2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:04:59.711905 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bfdc826a-ff96-4a93-beec-0be2f0ac1fa2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.172325 Jul 11 21:04:59.712505 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 371/748] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:04:59 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:00.733122 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d680d9c8-4fd8-468d-99cf-fd7e7f107484 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:00.734098 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d680d9c8-4fd8-468d-99cf-fd7e7f107484 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:00.742322 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d680d9c8-4fd8-468d-99cf-fd7e7f107484 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:00.742767 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d680d9c8-4fd8-468d-99cf-fd7e7f107484 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:00.743523 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d680d9c8-4fd8-468d-99cf-fd7e7f107484 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:00.743950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d680d9c8-4fd8-468d-99cf-fd7e7f107484 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:00.890364 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d680d9c8-4fd8-468d-99cf-fd7e7f107484 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:00.898393 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d680d9c8-4fd8-468d-99cf-fd7e7f107484 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.171749 Jul 11 21:05:00.898972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 378/749] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:00 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:01.919343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-962cf1d5-a615-4b8c-ad88-9c0ebc398a20 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:01.920505 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-962cf1d5-a615-4b8c-ad88-9c0ebc398a20 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:01.932471 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-962cf1d5-a615-4b8c-ad88-9c0ebc398a20 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:01.933203 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-962cf1d5-a615-4b8c-ad88-9c0ebc398a20 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:01.934453 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-962cf1d5-a615-4b8c-ad88-9c0ebc398a20 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:01.935219 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-962cf1d5-a615-4b8c-ad88-9c0ebc398a20 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:02.087723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-962cf1d5-a615-4b8c-ad88-9c0ebc398a20 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:02.095678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-962cf1d5-a615-4b8c-ad88-9c0ebc398a20 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.182864 Jul 11 21:05:02.096269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 372/750] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:01 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:03.115962 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-df64eda0-5790-411c-a67b-c372fd267e0d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:03.116587 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-df64eda0-5790-411c-a67b-c372fd267e0d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:03.118511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:03.124062 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-df64eda0-5790-411c-a67b-c372fd267e0d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:03.124545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-df64eda0-5790-411c-a67b-c372fd267e0d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:03.125302 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-df64eda0-5790-411c-a67b-c372fd267e0d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:03.125727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-df64eda0-5790-411c-a67b-c372fd267e0d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:03.269027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-df64eda0-5790-411c-a67b-c372fd267e0d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:03.280758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-df64eda0-5790-411c-a67b-c372fd267e0d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.169715 Jul 11 21:05:03.281537 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 379/751] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:03 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:04.302134 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f1a49776-4437-4db1-ba22-b139937b996e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:04.302744 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f1a49776-4437-4db1-ba22-b139937b996e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:04.307781 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:04.308455 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:04.311139 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1a49776-4437-4db1-ba22-b139937b996e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:04.311575 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1a49776-4437-4db1-ba22-b139937b996e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:04.312384 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1a49776-4437-4db1-ba22-b139937b996e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:04.312807 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1a49776-4437-4db1-ba22-b139937b996e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:04.450830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f1a49776-4437-4db1-ba22-b139937b996e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:04.460799 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f1a49776-4437-4db1-ba22-b139937b996e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.165287 Jul 11 21:05:04.461368 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 373/752] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:04 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:05.477766 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-357cad93-0b13-48f5-8942-870798c421e0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:05.478448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-357cad93-0b13-48f5-8942-870798c421e0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:05.484633 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-357cad93-0b13-48f5-8942-870798c421e0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:05.485078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-357cad93-0b13-48f5-8942-870798c421e0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:05.485828 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-357cad93-0b13-48f5-8942-870798c421e0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:05.486256 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-357cad93-0b13-48f5-8942-870798c421e0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:05.624214 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-357cad93-0b13-48f5-8942-870798c421e0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:05.632220 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-357cad93-0b13-48f5-8942-870798c421e0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.158336 Jul 11 21:05:05.632796 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 380/753] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:05 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:06.650703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6138b33f-b056-4964-a8c2-bfb45f21153f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:06.651343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6138b33f-b056-4964-a8c2-bfb45f21153f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:06.658634 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6138b33f-b056-4964-a8c2-bfb45f21153f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:06.659115 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6138b33f-b056-4964-a8c2-bfb45f21153f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:06.660433 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6138b33f-b056-4964-a8c2-bfb45f21153f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:06.660782 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6138b33f-b056-4964-a8c2-bfb45f21153f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:06.800356 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6138b33f-b056-4964-a8c2-bfb45f21153f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:06.808594 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6138b33f-b056-4964-a8c2-bfb45f21153f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.162090 Jul 11 21:05:06.809123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 374/754] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:06 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:07.621079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-ffef99d9-45a8-41f3-a8f4-e141dd50919f req-cf038185-5e53-4210-95e7-99b3814ebdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ddede4-7286-447e-9b09-947fdc35bcec", "name": "network-vif-plugged", "status": "completed", "tag": "7ad2ae0e-ff81-4b5a-9775-83301f98f0cc"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:07.629634 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-ffef99d9-45a8-41f3-a8f4-e141dd50919f req-cf038185-5e53-4210-95e7-99b3814ebdb1 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:07.630125 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-ffef99d9-45a8-41f3-a8f4-e141dd50919f req-cf038185-5e53-4210-95e7-99b3814ebdb1 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:07.641566 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-ffef99d9-45a8-41f3-a8f4-e141dd50919f req-cf038185-5e53-4210-95e7-99b3814ebdb1 service nova] Creating event network-vif-plugged:7ad2ae0e-ff81-4b5a-9775-83301f98f0cc for instance a1ddede4-7286-447e-9b09-947fdc35bcec on hv-cinder-84902 Jul 11 21:05:07.646777 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-ffef99d9-45a8-41f3-a8f4-e141dd50919f req-cf038185-5e53-4210-95e7-99b3814ebdb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029535 Jul 11 21:05:07.647378 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 381/755] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:07.827973 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2c84fada-2fa9-4cf6-a1d4-8e7ca13f3622 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:07.828831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2c84fada-2fa9-4cf6-a1d4-8e7ca13f3622 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:07.836459 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2c84fada-2fa9-4cf6-a1d4-8e7ca13f3622 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:07.836882 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2c84fada-2fa9-4cf6-a1d4-8e7ca13f3622 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:07.837649 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2c84fada-2fa9-4cf6-a1d4-8e7ca13f3622 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:07.838071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2c84fada-2fa9-4cf6-a1d4-8e7ca13f3622 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:08.019332 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2c84fada-2fa9-4cf6-a1d4-8e7ca13f3622 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:08.027270 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2c84fada-2fa9-4cf6-a1d4-8e7ca13f3622 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.203882 Jul 11 21:05:08.027852 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 375/756] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:07 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:09.051207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cb2120a5-a693-4b7d-a5ed-08d9c6adc785 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:09.052508 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-cb2120a5-a693-4b7d-a5ed-08d9c6adc785 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:09.061043 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cb2120a5-a693-4b7d-a5ed-08d9c6adc785 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:09.061696 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cb2120a5-a693-4b7d-a5ed-08d9c6adc785 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:09.062851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cb2120a5-a693-4b7d-a5ed-08d9c6adc785 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:09.063424 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cb2120a5-a693-4b7d-a5ed-08d9c6adc785 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:09.217261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-cb2120a5-a693-4b7d-a5ed-08d9c6adc785 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:09.225859 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-cb2120a5-a693-4b7d-a5ed-08d9c6adc785 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1266 microversion: 2.1 time: 0.182995 Jul 11 21:05:09.226877 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 382/757] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:09 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:10.244834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-13c48b5a-76a4-4bf6-a511-ff3ffca98627 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:10.245450 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-13c48b5a-76a4-4bf6-a511-ff3ffca98627 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:10.252278 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13c48b5a-76a4-4bf6-a511-ff3ffca98627 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:10.252720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13c48b5a-76a4-4bf6-a511-ff3ffca98627 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:10.253477 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13c48b5a-76a4-4bf6-a511-ff3ffca98627 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:10.253902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13c48b5a-76a4-4bf6-a511-ff3ffca98627 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:10.395987 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-13c48b5a-76a4-4bf6-a511-ff3ffca98627 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:10.403959 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-13c48b5a-76a4-4bf6-a511-ff3ffca98627 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1453 microversion: 2.1 time: 0.164009 Jul 11 21:05:10.404535 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 376/758] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:10 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:10.420186 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d6f85b53-736c-4035-959a-a9d6c13409a2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:10.420815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d6f85b53-736c-4035-959a-a9d6c13409a2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:10.427569 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d6f85b53-736c-4035-959a-a9d6c13409a2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:10.428045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d6f85b53-736c-4035-959a-a9d6c13409a2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:10.428839 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d6f85b53-736c-4035-959a-a9d6c13409a2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:10.429259 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d6f85b53-736c-4035-959a-a9d6c13409a2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:10.565049 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d6f85b53-736c-4035-959a-a9d6c13409a2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:10.572764 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d6f85b53-736c-4035-959a-a9d6c13409a2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1453 microversion: 2.1 time: 0.156512 Jul 11 21:05:10.573333 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 383/759] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:10 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:12.159273 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-c52433b8-c7eb-44c6-a8dc-62d017c00b51 req-87071d5c-e3a9-4e18-8ce4-edd7dcfa523f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ddede4-7286-447e-9b09-947fdc35bcec", "tag": "7ad2ae0e-ff81-4b5a-9775-83301f98f0cc"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:12.167808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-c52433b8-c7eb-44c6-a8dc-62d017c00b51 req-87071d5c-e3a9-4e18-8ce4-edd7dcfa523f service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:12.168446 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-c52433b8-c7eb-44c6-a8dc-62d017c00b51 req-87071d5c-e3a9-4e18-8ce4-edd7dcfa523f service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:12.179819 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-c52433b8-c7eb-44c6-a8dc-62d017c00b51 req-87071d5c-e3a9-4e18-8ce4-edd7dcfa523f service nova] Creating event network-changed:7ad2ae0e-ff81-4b5a-9775-83301f98f0cc for instance a1ddede4-7286-447e-9b09-947fdc35bcec on hv-cinder-84902 Jul 11 21:05:12.185140 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-c52433b8-c7eb-44c6-a8dc-62d017c00b51 req-87071d5c-e3a9-4e18-8ce4-edd7dcfa523f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029517 Jul 11 21:05:12.185952 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 377/760] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:14.591250 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c79fc3b0-d55b-4244-9a42-b69f393b00c3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:14.591831 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c79fc3b0-d55b-4244-9a42-b69f393b00c3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:14.601066 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c79fc3b0-d55b-4244-9a42-b69f393b00c3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:14.601698 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c79fc3b0-d55b-4244-9a42-b69f393b00c3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:14.603160 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c79fc3b0-d55b-4244-9a42-b69f393b00c3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:14.603613 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c79fc3b0-d55b-4244-9a42-b69f393b00c3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:14.699780 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-c79fc3b0-d55b-4244-9a42-b69f393b00c3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lazy-loading 'services' on Instance uuid 49fff1a4-e60c-436d-b94c-e4e414557cbe {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:05:14.783558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c79fc3b0-d55b-4244-9a42-b69f393b00c3 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments/3631bd83-6dd6-4b13-8c0f-4e2e5428330e" status: 202 len: 0 microversion: 2.1 time: 0.198935 Jul 11 21:05:14.784089 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 384/761] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:05:14 2022] DELETE /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments/3631bd83-6dd6-4b13-8c0f-4e2e5428330e => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:05:14.794140 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f0bf712a-880d-458c-b934-28e7e77f5a28 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:14.795146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f0bf712a-880d-458c-b934-28e7e77f5a28 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:14.801992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f0bf712a-880d-458c-b934-28e7e77f5a28 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:14.802543 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f0bf712a-880d-458c-b934-28e7e77f5a28 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:14.803376 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f0bf712a-880d-458c-b934-28e7e77f5a28 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:14.803853 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f0bf712a-880d-458c-b934-28e7e77f5a28 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:14.838520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f0bf712a-880d-458c-b934-28e7e77f5a28 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049519 Jul 11 21:05:14.839103 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 378/762] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:05:14 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:05:15.851273 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f06cd19e-67ef-4225-80f8-60594e9c9c9d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:15.852439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f06cd19e-67ef-4225-80f8-60594e9c9c9d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:15.859775 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f06cd19e-67ef-4225-80f8-60594e9c9c9d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:15.860249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f06cd19e-67ef-4225-80f8-60594e9c9c9d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:15.861041 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f06cd19e-67ef-4225-80f8-60594e9c9c9d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:15.861481 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f06cd19e-67ef-4225-80f8-60594e9c9c9d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:15.891063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f06cd19e-67ef-4225-80f8-60594e9c9c9d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044216 Jul 11 21:05:15.891632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 385/763] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:05:15 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 21:05:15.964158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5fad4095-06f6-44cc-95ae-a45445181d24 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:15.964675 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5fad4095-06f6-44cc-95ae-a45445181d24 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:15.971199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5fad4095-06f6-44cc-95ae-a45445181d24 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:15.971650 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5fad4095-06f6-44cc-95ae-a45445181d24 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:15.972470 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5fad4095-06f6-44cc-95ae-a45445181d24 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:15.972906 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5fad4095-06f6-44cc-95ae-a45445181d24 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:15.998551 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5fad4095-06f6-44cc-95ae-a45445181d24 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:05:16.080250 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5fad4095-06f6-44cc-95ae-a45445181d24 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 204 len: 0 microversion: 2.1 time: 0.120273 Jul 11 21:05:16.081148 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 379/764] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:05:15 2022] DELETE /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:05:16.089398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-73a0c12c-ce4e-4fb5-86a0-266776107702 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:16.090007 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-73a0c12c-ce4e-4fb5-86a0-266776107702 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:16.096139 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-73a0c12c-ce4e-4fb5-86a0-266776107702 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:16.096620 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-73a0c12c-ce4e-4fb5-86a0-266776107702 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:16.097368 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-73a0c12c-ce4e-4fb5-86a0-266776107702 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:16.097810 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-73a0c12c-ce4e-4fb5-86a0-266776107702 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:16.235635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-73a0c12c-ce4e-4fb5-86a0-266776107702 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:16.247041 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-73a0c12c-ce4e-4fb5-86a0-266776107702 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1690 microversion: 2.1 time: 0.161327 Jul 11 21:05:16.247891 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 386/765] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:16 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:17.273272 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c228a867-8aa0-47b2-96fc-fe95fe3f7bd1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:17.274408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c228a867-8aa0-47b2-96fc-fe95fe3f7bd1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:17.282107 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c228a867-8aa0-47b2-96fc-fe95fe3f7bd1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:17.282601 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c228a867-8aa0-47b2-96fc-fe95fe3f7bd1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:17.283330 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c228a867-8aa0-47b2-96fc-fe95fe3f7bd1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:17.283779 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c228a867-8aa0-47b2-96fc-fe95fe3f7bd1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:17.431003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c228a867-8aa0-47b2-96fc-fe95fe3f7bd1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:17.439054 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c228a867-8aa0-47b2-96fc-fe95fe3f7bd1 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1690 microversion: 2.1 time: 0.172799 Jul 11 21:05:17.439687 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 380/766] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:17 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:18.459213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d2786281-32c7-42b3-81c7-83b30729642c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:18.460028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d2786281-32c7-42b3-81c7-83b30729642c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:18.467807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d2786281-32c7-42b3-81c7-83b30729642c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:18.468516 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d2786281-32c7-42b3-81c7-83b30729642c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:18.469671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d2786281-32c7-42b3-81c7-83b30729642c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:18.470313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d2786281-32c7-42b3-81c7-83b30729642c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:18.613888 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d2786281-32c7-42b3-81c7-83b30729642c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:18.621908 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d2786281-32c7-42b3-81c7-83b30729642c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1690 microversion: 2.1 time: 0.168527 Jul 11 21:05:18.622811 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 387/767] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:18 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:19.639838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-886b079a-9ce7-46fc-99f8-da4359fa3a3d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:19.640492 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-886b079a-9ce7-46fc-99f8-da4359fa3a3d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:19.648480 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-886b079a-9ce7-46fc-99f8-da4359fa3a3d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:19.648913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-886b079a-9ce7-46fc-99f8-da4359fa3a3d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:19.649669 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-886b079a-9ce7-46fc-99f8-da4359fa3a3d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:19.650117 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-886b079a-9ce7-46fc-99f8-da4359fa3a3d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:19.855441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-886b079a-9ce7-46fc-99f8-da4359fa3a3d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:19.863562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-886b079a-9ce7-46fc-99f8-da4359fa3a3d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 200 len: 1690 microversion: 2.1 time: 0.227652 Jul 11 21:05:19.864666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 381/768] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:19 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:20.271276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-78584af3-d169-40d5-9fc8-8a7ae58d5a87 req-80b3e180-ddee-473e-b56f-b31dd2aaa434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fff1a4-e60c-436d-b94c-e4e414557cbe", "name": "network-vif-deleted", "tag": "6b32af85-d1d7-4e52-9152-d26b348afac0"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:20.280025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-78584af3-d169-40d5-9fc8-8a7ae58d5a87 req-80b3e180-ddee-473e-b56f-b31dd2aaa434 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:20.280487 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-78584af3-d169-40d5-9fc8-8a7ae58d5a87 req-80b3e180-ddee-473e-b56f-b31dd2aaa434 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:20.284424 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:20.293669 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-78584af3-d169-40d5-9fc8-8a7ae58d5a87 req-80b3e180-ddee-473e-b56f-b31dd2aaa434 service nova] Creating event network-vif-deleted:6b32af85-d1d7-4e52-9152-d26b348afac0 for instance 49fff1a4-e60c-436d-b94c-e4e414557cbe on hv-cinder-84902 Jul 11 21:05:20.300012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-78584af3-d169-40d5-9fc8-8a7ae58d5a87 req-80b3e180-ddee-473e-b56f-b31dd2aaa434 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031984 Jul 11 21:05:20.301000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 388/769] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:20.881694 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:20.883009 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 49fff1a4-e60c-436d-b94c-e4e414557cbe] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:20.889826 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:20.890287 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:20.891059 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:20.891519 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:20.905693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] HTTP exception thrown: Instance 49fff1a4-e60c-436d-b94c-e4e414557cbe could not be found. Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Request method failure captured: Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe HTTP/1.1 Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI62lRWdgL26NSoKvMm26ZR-MIh8lmsoilICwbHhZnefhyhzZZn4QE3yYGVFYUEf6Gb7DhWQjbnLqk-TfBxwd3HjP10g6J39OOhDcjatM8tyLGCx3fY8gZ1ahcVk4eSU13TT33VA4MEvj266VSZq1shx9AlAMKROF46H5Fp0GmVFal4 Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:05:20.907553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6f21a94f61e42c9b967e673f02eb270", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: aa7e6c5842a84e91ac94c1107ad29158 Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 49fff1a4-e60c-436d-b94c-e4e414557cbe could not be found. Jul 11 21:05:20.909176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '49fff1a4-e60c-436d-b94c-e4e414557cbe'} Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49fff1a4-e60c-436d-b94c-e4e414557cbe could not be found. Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:05:20.910065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49fff1a4-e60c-436d-b94c-e4e414557cbe could not be found. Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49fff1a4-e60c-436d-b94c-e4e414557cbe could not be found. Jul 11 21:05:20.911545 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:20.913048 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Returning 404 to user: Instance 49fff1a4-e60c-436d-b94c-e4e414557cbe could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:05:20.913936 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6e65b115-5a0e-4ae2-a689-b1f195f8a9b0 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe" status: 404 len: 111 microversion: 2.1 time: 0.036400 Jul 11 21:05:20.914494 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 382/770] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:20 2022] GET /compute/v2.1/servers/49fff1a4-e60c-436d-b94c-e4e414557cbe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:05:20.924639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-87d85956-2f01-437a-b804-27ebf35cdb68 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '.version_select at 0x7f384038a1f0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:20.944783 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-87d85956-2f01-437a-b804-27ebf35cdb68 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944537304" status: 202 len: 0 microversion: 2.1 time: 0.025393 Jul 11 21:05:20.945422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 389/771] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jul 11 21:05:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944537304 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:05:23.930675 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a19408a6-deb8-4905-8ff2-c315c8aa58e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:23.931196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a19408a6-deb8-4905-8ff2-c315c8aa58e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:23.933649 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:23.939385 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a19408a6-deb8-4905-8ff2-c315c8aa58e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:23.939953 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a19408a6-deb8-4905-8ff2-c315c8aa58e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:23.940764 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a19408a6-deb8-4905-8ff2-c315c8aa58e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:23.941200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a19408a6-deb8-4905-8ff2-c315c8aa58e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:23.944969 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:23.970667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a19408a6-deb8-4905-8ff2-c315c8aa58e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:05:24.058529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a19408a6-deb8-4905-8ff2-c315c8aa58e8 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "DELETE /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 204 len: 0 microversion: 2.1 time: 0.131724 Jul 11 21:05:24.059230 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 383/772] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:05:23 2022] DELETE /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:05:24.067501 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-091c1a34-0d89-464d-b10d-9a8066af50a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:24.068309 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-091c1a34-0d89-464d-b10d-9a8066af50a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:24.070280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:24.076206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-091c1a34-0d89-464d-b10d-9a8066af50a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:24.076761 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-091c1a34-0d89-464d-b10d-9a8066af50a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:24.077530 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-091c1a34-0d89-464d-b10d-9a8066af50a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:24.077961 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-091c1a34-0d89-464d-b10d-9a8066af50a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:24.221787 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-091c1a34-0d89-464d-b10d-9a8066af50a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:24.229735 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-091c1a34-0d89-464d-b10d-9a8066af50a6 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1507 microversion: 2.1 time: 0.166289 Jul 11 21:05:24.230311 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 390/773] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:24 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:24.379879 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-706cb104-7308-41ea-953d-25f1cba0aed1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:24.381147 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-706cb104-7308-41ea-953d-25f1cba0aed1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:24.387415 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-706cb104-7308-41ea-953d-25f1cba0aed1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:24.387858 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-706cb104-7308-41ea-953d-25f1cba0aed1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:24.388655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-706cb104-7308-41ea-953d-25f1cba0aed1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:24.389078 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-706cb104-7308-41ea-953d-25f1cba0aed1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:24.420865 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-706cb104-7308-41ea-953d-25f1cba0aed1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045284 Jul 11 21:05:24.421341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 384/774] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:05:24 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 21:05:24.500032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a695b09d-89e4-478b-8b5d-083b2ec685ec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:24.500546 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a695b09d-89e4-478b-8b5d-083b2ec685ec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:24.507202 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a695b09d-89e4-478b-8b5d-083b2ec685ec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:24.507640 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a695b09d-89e4-478b-8b5d-083b2ec685ec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:24.508420 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a695b09d-89e4-478b-8b5d-083b2ec685ec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:24.508845 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a695b09d-89e4-478b-8b5d-083b2ec685ec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:24.534260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a695b09d-89e4-478b-8b5d-083b2ec685ec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:05:24.628131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a695b09d-89e4-478b-8b5d-083b2ec685ec tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 204 len: 0 microversion: 2.1 time: 0.131379 Jul 11 21:05:24.629577 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 391/775] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:05:24 2022] DELETE /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:05:24.638272 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6f43b3f5-dd4b-4e46-b242-09a3948baa44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:24.638889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6f43b3f5-dd4b-4e46-b242-09a3948baa44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:24.645446 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6f43b3f5-dd4b-4e46-b242-09a3948baa44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:24.645905 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6f43b3f5-dd4b-4e46-b242-09a3948baa44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:24.646823 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6f43b3f5-dd4b-4e46-b242-09a3948baa44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:24.647286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6f43b3f5-dd4b-4e46-b242-09a3948baa44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:24.779510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6f43b3f5-dd4b-4e46-b242-09a3948baa44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:24.788385 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6f43b3f5-dd4b-4e46-b242-09a3948baa44 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1672 microversion: 2.1 time: 0.154036 Jul 11 21:05:24.788969 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 385/776] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:24 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:25.247919 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-17805a3f-ce23-4f8a-b1be-8eedcc072998 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:25.248689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-17805a3f-ce23-4f8a-b1be-8eedcc072998 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:25.255708 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-17805a3f-ce23-4f8a-b1be-8eedcc072998 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:25.256140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-17805a3f-ce23-4f8a-b1be-8eedcc072998 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:25.256968 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-17805a3f-ce23-4f8a-b1be-8eedcc072998 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:25.257444 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-17805a3f-ce23-4f8a-b1be-8eedcc072998 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:25.403390 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-17805a3f-ce23-4f8a-b1be-8eedcc072998 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:25.411592 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-17805a3f-ce23-4f8a-b1be-8eedcc072998 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1507 microversion: 2.1 time: 0.168447 Jul 11 21:05:25.412792 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 392/777] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:25 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:25.807897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-de27b79e-885d-485f-a8f1-34489d894af5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:25.808550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-de27b79e-885d-485f-a8f1-34489d894af5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:25.815529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-de27b79e-885d-485f-a8f1-34489d894af5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:25.816002 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-de27b79e-885d-485f-a8f1-34489d894af5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:25.816895 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-de27b79e-885d-485f-a8f1-34489d894af5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:25.820164 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-de27b79e-885d-485f-a8f1-34489d894af5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:26.032866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-de27b79e-885d-485f-a8f1-34489d894af5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:26.041238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-de27b79e-885d-485f-a8f1-34489d894af5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1672 microversion: 2.1 time: 0.237342 Jul 11 21:05:26.041819 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 386/778] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:25 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1672 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:26.435378 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e1cc59c8-ddab-48c7-b739-315f7d51f9ed tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:26.436627 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e1cc59c8-ddab-48c7-b739-315f7d51f9ed tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:26.444539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e1cc59c8-ddab-48c7-b739-315f7d51f9ed tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:26.445217 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e1cc59c8-ddab-48c7-b739-315f7d51f9ed tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:26.446323 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e1cc59c8-ddab-48c7-b739-315f7d51f9ed tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:26.446975 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e1cc59c8-ddab-48c7-b739-315f7d51f9ed tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:26.462561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-8058a3a7-bea9-42ec-9980-494cd90df1d4 req-6e5979f6-d772-4869-be41-1641fcadd0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389834b1-1b82-41ba-8cfa-9c009f0446de", "name": "network-vif-deleted", "tag": "ea0118de-f9e0-41d5-8073-29cbf9ea684d"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:26.478991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-8058a3a7-bea9-42ec-9980-494cd90df1d4 req-6e5979f6-d772-4869-be41-1641fcadd0df service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:26.479618 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-8058a3a7-bea9-42ec-9980-494cd90df1d4 req-6e5979f6-d772-4869-be41-1641fcadd0df service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:26.494318 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-8058a3a7-bea9-42ec-9980-494cd90df1d4 req-6e5979f6-d772-4869-be41-1641fcadd0df service nova] Creating event network-vif-deleted:ea0118de-f9e0-41d5-8073-29cbf9ea684d for instance 389834b1-1b82-41ba-8cfa-9c009f0446de on hv-cinder-84902 Jul 11 21:05:26.501251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-8058a3a7-bea9-42ec-9980-494cd90df1d4 req-6e5979f6-d772-4869-be41-1641fcadd0df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044820 Jul 11 21:05:26.502271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 387/779] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:26.522892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e1cc59c8-ddab-48c7-b739-315f7d51f9ed tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:26.532274 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e1cc59c8-ddab-48c7-b739-315f7d51f9ed tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 200 len: 1465 microversion: 2.1 time: 0.101007 Jul 11 21:05:26.532862 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 393/780] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:26 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 1465 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:27.059411 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a5cfd2f2-ee53-4c67-9565-7acba099038b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:27.060752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a5cfd2f2-ee53-4c67-9565-7acba099038b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:27.069177 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f2-ee53-4c67-9565-7acba099038b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:27.069594 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f2-ee53-4c67-9565-7acba099038b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:27.070583 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f2-ee53-4c67-9565-7acba099038b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:27.070981 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f2-ee53-4c67-9565-7acba099038b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:27.155895 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a5cfd2f2-ee53-4c67-9565-7acba099038b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:27.167016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a5cfd2f2-ee53-4c67-9565-7acba099038b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 200 len: 1604 microversion: 2.1 time: 0.111746 Jul 11 21:05:27.167607 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 388/781] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:27 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 1604 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:27.550324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:27.550914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: 389834b1-1b82-41ba-8cfa-9c009f0446de] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:27.557666 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:27.558127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:27.558879 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:27.559305 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:27.573164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] HTTP exception thrown: Instance 389834b1-1b82-41ba-8cfa-9c009f0446de could not be found. Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Request method failure captured: Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de HTTP/1.1 Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI62lRWdgL26NSoKvMm26ZR-MIh8lmsoilICwbHhZnefhyhzZZn4QE3yYGVFYUEf6Gb7DhWQjbnLqk-TfBxwd3HjP10g6J39OOhDcjatM8tyLGCx3fY8gZ1ahcVk4eSU13TT33VA4MEvj266VSZq1shx9AlAMKROF46H5Fp0GmVFal4 Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:05:27.574949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6f21a94f61e42c9b967e673f02eb270", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: aa7e6c5842a84e91ac94c1107ad29158 Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 389834b1-1b82-41ba-8cfa-9c009f0446de could not be found. Jul 11 21:05:27.576621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '389834b1-1b82-41ba-8cfa-9c009f0446de'} Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 389834b1-1b82-41ba-8cfa-9c009f0446de could not be found. Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:05:27.577511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 389834b1-1b82-41ba-8cfa-9c009f0446de could not be found. Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 389834b1-1b82-41ba-8cfa-9c009f0446de could not be found. Jul 11 21:05:27.579018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:27.580517 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Returning 404 to user: Instance 389834b1-1b82-41ba-8cfa-9c009f0446de could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:05:27.580517 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b64d350d-c54d-4260-bfe7-5ac6c1f94146 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de" status: 404 len: 111 microversion: 2.1 time: 0.030412 Jul 11 21:05:27.580517 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 394/782] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:27 2022] GET /compute/v2.1/servers/389834b1-1b82-41ba-8cfa-9c009f0446de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:05:27.586196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-27d62130-d779-4f47-bc1a-53be0c56d13c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:27.586717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-27d62130-d779-4f47-bc1a-53be0c56d13c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:27.593341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-27d62130-d779-4f47-bc1a-53be0c56d13c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:27.593792 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-27d62130-d779-4f47-bc1a-53be0c56d13c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:27.594561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-27d62130-d779-4f47-bc1a-53be0c56d13c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:27.594992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-27d62130-d779-4f47-bc1a-53be0c56d13c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:27.621722 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-27d62130-d779-4f47-bc1a-53be0c56d13c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:05:27.706833 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-27d62130-d779-4f47-bc1a-53be0c56d13c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 204 len: 0 microversion: 2.1 time: 0.123632 Jul 11 21:05:27.710530 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 389/783] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:05:27 2022] DELETE /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:05:27.718731 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1240eede-242f-4680-b214-fff2d5de6f1d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:27.719346 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1240eede-242f-4680-b214-fff2d5de6f1d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:27.727148 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1240eede-242f-4680-b214-fff2d5de6f1d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:27.727707 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1240eede-242f-4680-b214-fff2d5de6f1d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:27.728739 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1240eede-242f-4680-b214-fff2d5de6f1d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:27.729228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1240eede-242f-4680-b214-fff2d5de6f1d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:27.884097 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1240eede-242f-4680-b214-fff2d5de6f1d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:27.891797 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1240eede-242f-4680-b214-fff2d5de6f1d tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.177647 Jul 11 21:05:27.892372 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 395/784] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:27 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:28.185449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:28.186168 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:28.192781 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:28.193228 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:28.194195 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:28.194818 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:28.211316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] HTTP exception thrown: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Request method failure captured: Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c HTTP/1.1 Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI6-_4zfdvQN9fJEMl4UEvMWtB8x8f-2irLg7Rz3SIuKsnm0VDrz9Xg79CBJpB5ePJeIElcdQc1aaw-qIcTbtRftjY1QHVke1UVVoO766ShN4f4NAudN6yZOV8NJjVY0_w-Zvf_r6nLndKryWVjhzNiGeZSsFHQigf58He62TYU3V7E Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:05:28.213257 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_367a52be93e24b5eaf528a48342d47b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 0965444614ae486e80e111f4126b52f1 Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:05:28.214866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '88d87067-da01-484a-86ca-e2ec49f5f15c'} Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:05:28.215804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:05:28.217260 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:05:28.219233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Returning 404 to user: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:05:28.220093 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-510fb793-d2de-4863-83c7-a959c4f26be0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 404 len: 111 microversion: 2.1 time: 0.039011 Jul 11 21:05:28.220944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 390/785] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:28 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 21:05:28.229502 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f1a7107d-bd64-4597-8805-8bee92a6b797 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '.version_select at 0x7f38402a6a60>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:28.252932 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f1a7107d-bd64-4597-8805-8bee92a6b797 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095672979" status: 202 len: 0 microversion: 2.1 time: 0.027148 Jul 11 21:05:28.253515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 396/786] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jul 11 21:05:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095672979 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:05:28.538574 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-14d9b1e3-2fcc-4763-a6eb-52e8ba2bb07a req-e341b8d9-ce01-4d94-badc-9dd5486463fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d87067-da01-484a-86ca-e2ec49f5f15c", "name": "network-vif-deleted", "tag": "425242f4-2849-48e1-b30f-b35706e4c781"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:28.546841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-14d9b1e3-2fcc-4763-a6eb-52e8ba2bb07a req-e341b8d9-ce01-4d94-badc-9dd5486463fe service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:28.547277 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-14d9b1e3-2fcc-4763-a6eb-52e8ba2bb07a req-e341b8d9-ce01-4d94-badc-9dd5486463fe service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:28.559788 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-14d9b1e3-2fcc-4763-a6eb-52e8ba2bb07a req-e341b8d9-ce01-4d94-badc-9dd5486463fe service nova] Creating event network-vif-deleted:425242f4-2849-48e1-b30f-b35706e4c781 for instance 88d87067-da01-484a-86ca-e2ec49f5f15c on hv-cinder-84902 Jul 11 21:05:28.564487 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-14d9b1e3-2fcc-4763-a6eb-52e8ba2bb07a req-e341b8d9-ce01-4d94-badc-9dd5486463fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032174 Jul 11 21:05:28.565082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 391/787] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:28.908349 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2fa89afd-5dbb-446f-b04f-01d313ebd972 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'create', calling method: .version_select at 0x7f3840217280>, body: {"keypair": {"name": "tempest-keypair-474803676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfzJEBkoIs4HVenAKY98mxshGfiW1ishOlgtskt0Di3SorzMkaOBBq0wKzT/8rRENRggf0sbZGFMZYjldoeIYwoFO6zKSedvv7zafdXQWCvXvqIoX/OO5996jZ1m4RMRg=="}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:28.909929 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9c324f6b-a2a9-47b9-8baf-05ea0687d668 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:28.910617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9c324f6b-a2a9-47b9-8baf-05ea0687d668 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:28.917639 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9c324f6b-a2a9-47b9-8baf-05ea0687d668 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:28.918362 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9c324f6b-a2a9-47b9-8baf-05ea0687d668 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:28.919123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9c324f6b-a2a9-47b9-8baf-05ea0687d668 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:28.920270 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9c324f6b-a2a9-47b9-8baf-05ea0687d668 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:28.923756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-2fa89afd-5dbb-446f-b04f-01d313ebd972 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Getting quotas for project 367a52be93e24b5eaf528a48342d47b3. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:05:28.928538 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-2fa89afd-5dbb-446f-b04f-01d313ebd972 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Getting quotas for user 0965444614ae486e80e111f4126b52f1 and project 367a52be93e24b5eaf528a48342d47b3. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:05:28.955716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2fa89afd-5dbb-446f-b04f-01d313ebd972 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051430 Jul 11 21:05:28.956378 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 397/788] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 21:05:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:29.178082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9c324f6b-a2a9-47b9-8baf-05ea0687d668 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7e6c5842a84e91ac94c1107ad29158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f21a94f61e42c9b967e673f02eb270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:29.186126 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9c324f6b-a2a9-47b9-8baf-05ea0687d668 tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 200 len: 1520 microversion: 2.1 time: 0.280524 Jul 11 21:05:29.186729 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 392/789] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:28 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:30.203782 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:30.204541 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] [instance: d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:30.212482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:30.212927 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:30.213884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:30.214311 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:30.231038 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] HTTP exception thrown: Instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 could not be found. Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Request method failure captured: Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 HTTP/1.1 Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI62lRWdgL26NSoKvMm26ZR-MIh8lmsoilICwbHhZnefhyhzZZn4QE3yYGVFYUEf6Gb7DhWQjbnLqk-TfBxwd3HjP10g6J39OOhDcjatM8tyLGCx3fY8gZ1ahcVk4eSU13TT33VA4MEvj266VSZq1shx9AlAMKROF46H5Fp0GmVFal4 Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:05:30.232545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6f21a94f61e42c9b967e673f02eb270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6f21a94f61e42c9b967e673f02eb270", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: c6f21a94f61e42c9b967e673f02eb270 Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1701067456 Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: aa7e6c5842a84e91ac94c1107ad29158 Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1701067456-project Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 could not be found. Jul 11 21:05:30.234120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'd5b0e455-1e94-4e5c-b6c1-9a03cfcc3591'} Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 could not be found. Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:05:30.235000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 could not be found. Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 could not be found. Jul 11 21:05:30.236525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:05:30.237808 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] Returning 404 to user: Instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:05:30.237808 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3251a700-975e-4a30-8d4a-baaab456676c tempest-ServerRescueNegativeTestJSON-1701067456 tempest-ServerRescueNegativeTestJSON-1701067456-project] 10.222.0.20 "GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591" status: 404 len: 111 microversion: 2.1 time: 0.034339 Jul 11 21:05:30.237808 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 398/790] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:30 2022] GET /compute/v2.1/servers/d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:05:30.582803 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-028cccf5-4ffa-4dbc-9c99-c511ca956561 req-e41dd66b-6aaf-4945-b13e-728ccbf2967f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591", "name": "network-vif-deleted", "tag": "2414340f-b581-402b-8a8d-335e26258bd9"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:30.592377 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-028cccf5-4ffa-4dbc-9c99-c511ca956561 req-e41dd66b-6aaf-4945-b13e-728ccbf2967f service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:30.592892 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-028cccf5-4ffa-4dbc-9c99-c511ca956561 req-e41dd66b-6aaf-4945-b13e-728ccbf2967f service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:30.606425 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-028cccf5-4ffa-4dbc-9c99-c511ca956561 req-e41dd66b-6aaf-4945-b13e-728ccbf2967f service nova] Creating event network-vif-deleted:2414340f-b581-402b-8a8d-335e26258bd9 for instance d5b0e455-1e94-4e5c-b6c1-9a03cfcc3591 on hv-cinder-84902 Jul 11 21:05:30.611600 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-028cccf5-4ffa-4dbc-9c99-c511ca956561 req-e41dd66b-6aaf-4945-b13e-728ccbf2967f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032911 Jul 11 21:05:30.612963 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 393/791] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:30.733899 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1199088131", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff1ba024-4762-40b1-8a58-2da0dcdba95a"}], "security_groups": [{"name": "tempest-securitygroup--945551471"}], "key_name": "tempest-keypair-474803676", "user_data": "}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:31.140048 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.network.neutron [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] validate_networks() for [('ff1ba024-4762-40b1-8a58-2da0dcdba95a', None, None, None, None, None)] {{(pid=118013) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:05:31.795798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Flavor limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:05:31.796960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Image limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:05:31.797431 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Flavor pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:05:31.797834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Image pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:05:31.798239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:05:31.808164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:31.808651 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:31.809444 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:31.809880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:31.827615 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Getting quotas for project 367a52be93e24b5eaf528a48342d47b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:05:31.832207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Getting quotas for user 0965444614ae486e80e111f4126b52f1 and project 367a52be93e24b5eaf528a48342d47b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:05:31.844927 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Going to run 1 instances... {{(pid=118013) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:05:31.847619 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118013) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:05:31.906331 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ad0b73ad-2d07-4d02-8158-221b42fe8596 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.176739 Jul 11 21:05:31.907283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 399/792] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:05:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:05:31.918240 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a323ee04-4ce7-449a-b67e-8ffdc0a47670 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:31.918955 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a323ee04-4ce7-449a-b67e-8ffdc0a47670 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:31.981796 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a323ee04-4ce7-449a-b67e-8ffdc0a47670 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:31.988742 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a323ee04-4ce7-449a-b67e-8ffdc0a47670 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1237 microversion: 2.1 time: 0.075325 Jul 11 21:05:31.991421 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 394/793] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:31 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:33.007238 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b01e2a83-c1e2-4709-a23b-5b47f70cd0fb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:33.007850 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b01e2a83-c1e2-4709-a23b-5b47f70cd0fb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:33.014206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b01e2a83-c1e2-4709-a23b-5b47f70cd0fb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:33.014912 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b01e2a83-c1e2-4709-a23b-5b47f70cd0fb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:33.015852 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b01e2a83-c1e2-4709-a23b-5b47f70cd0fb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:33.016472 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b01e2a83-c1e2-4709-a23b-5b47f70cd0fb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:33.108557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b01e2a83-c1e2-4709-a23b-5b47f70cd0fb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:33.116546 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b01e2a83-c1e2-4709-a23b-5b47f70cd0fb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1289 microversion: 2.1 time: 0.113285 Jul 11 21:05:33.117121 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 400/794] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:33 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:34.133879 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-64d757c8-28a5-4f8d-b043-60970d924bf2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:34.134501 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-64d757c8-28a5-4f8d-b043-60970d924bf2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:34.142563 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-64d757c8-28a5-4f8d-b043-60970d924bf2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:34.143223 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-64d757c8-28a5-4f8d-b043-60970d924bf2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:34.144217 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-64d757c8-28a5-4f8d-b043-60970d924bf2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:34.144809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-64d757c8-28a5-4f8d-b043-60970d924bf2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:34.236652 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-64d757c8-28a5-4f8d-b043-60970d924bf2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:34.246495 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-64d757c8-28a5-4f8d-b043-60970d924bf2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1295 microversion: 2.1 time: 0.116579 Jul 11 21:05:34.257034 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 395/795] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:34 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1295 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:34.872527 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d4405547-82dc-4ed9-a1a5-68d7c29843c9 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:34.873688 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d4405547-82dc-4ed9-a1a5-68d7c29843c9 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:34.880531 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d4405547-82dc-4ed9-a1a5-68d7c29843c9 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:34.881612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d4405547-82dc-4ed9-a1a5-68d7c29843c9 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:34.882695 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d4405547-82dc-4ed9-a1a5-68d7c29843c9 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:34.883433 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d4405547-82dc-4ed9-a1a5-68d7c29843c9 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:34.965250 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d4405547-82dc-4ed9-a1a5-68d7c29843c9 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "POST /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/action" status: 202 len: 0 microversion: 2.1 time: 0.096671 Jul 11 21:05:34.966087 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 401/796] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:05:34 2022] POST /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:05:34.975629 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e1b6b3a4-b624-4dbd-805d-2d53bd73d084 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:34.976292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e1b6b3a4-b624-4dbd-805d-2d53bd73d084 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:34.984571 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e1b6b3a4-b624-4dbd-805d-2d53bd73d084 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:34.985056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e1b6b3a4-b624-4dbd-805d-2d53bd73d084 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:34.985902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e1b6b3a4-b624-4dbd-805d-2d53bd73d084 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:34.986324 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e1b6b3a4-b624-4dbd-805d-2d53bd73d084 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:35.270590 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b742cab8-7ca0-4a4f-9b89-ac2842bbb8c6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:35.271363 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b742cab8-7ca0-4a4f-9b89-ac2842bbb8c6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:35.280890 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b742cab8-7ca0-4a4f-9b89-ac2842bbb8c6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:35.281647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b742cab8-7ca0-4a4f-9b89-ac2842bbb8c6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:35.286609 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b742cab8-7ca0-4a4f-9b89-ac2842bbb8c6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:35.287915 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b742cab8-7ca0-4a4f-9b89-ac2842bbb8c6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:35.366357 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e1b6b3a4-b624-4dbd-805d-2d53bd73d084 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:35.374867 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e1b6b3a4-b624-4dbd-805d-2d53bd73d084 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1752 microversion: 2.1 time: 0.404180 Jul 11 21:05:35.375379 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 396/797] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:34 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1752 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:35.472100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b742cab8-7ca0-4a4f-9b89-ac2842bbb8c6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:35.482384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b742cab8-7ca0-4a4f-9b89-ac2842bbb8c6 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1362 microversion: 2.1 time: 0.217542 Jul 11 21:05:35.483176 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 402/798] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:35 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:35.685334 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-2d61e117-defa-403e-8ff8-0b8345677a17 req-6b585271-6e06-4dc8-b8ba-55a22822f55e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582e2e88-f321-4be4-8030-ce7a59d27211", "tag": "1edf8c56-e0a4-46ea-a0ea-b8208cec4797"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:35.703926 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-2d61e117-defa-403e-8ff8-0b8345677a17 req-6b585271-6e06-4dc8-b8ba-55a22822f55e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:35.705253 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-2d61e117-defa-403e-8ff8-0b8345677a17 req-6b585271-6e06-4dc8-b8ba-55a22822f55e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:35.727459 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-2d61e117-defa-403e-8ff8-0b8345677a17 req-6b585271-6e06-4dc8-b8ba-55a22822f55e service nova] Creating event network-changed:1edf8c56-e0a4-46ea-a0ea-b8208cec4797 for instance 582e2e88-f321-4be4-8030-ce7a59d27211 on hv-cinder-84902 Jul 11 21:05:35.735067 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-2d61e117-defa-403e-8ff8-0b8345677a17 req-6b585271-6e06-4dc8-b8ba-55a22822f55e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054578 Jul 11 21:05:35.736145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 397/799] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:36.393147 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-209eceb5-a84a-4cf2-ad45-57372691b851 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:36.394430 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-209eceb5-a84a-4cf2-ad45-57372691b851 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:36.401438 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-209eceb5-a84a-4cf2-ad45-57372691b851 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:36.402268 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-209eceb5-a84a-4cf2-ad45-57372691b851 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:36.402991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-209eceb5-a84a-4cf2-ad45-57372691b851 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:36.403439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-209eceb5-a84a-4cf2-ad45-57372691b851 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:36.500150 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5f731ded-0ecb-4e88-8d5f-34201c9d4a77 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:36.501044 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5f731ded-0ecb-4e88-8d5f-34201c9d4a77 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:36.509413 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5f731ded-0ecb-4e88-8d5f-34201c9d4a77 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:36.510152 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5f731ded-0ecb-4e88-8d5f-34201c9d4a77 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:36.511105 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5f731ded-0ecb-4e88-8d5f-34201c9d4a77 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:36.511698 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5f731ded-0ecb-4e88-8d5f-34201c9d4a77 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:36.621509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-209eceb5-a84a-4cf2-ad45-57372691b851 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:36.648697 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-209eceb5-a84a-4cf2-ad45-57372691b851 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1752 microversion: 2.1 time: 0.259168 Jul 11 21:05:36.649645 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 403/800] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:36 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1752 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:36.716743 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5f731ded-0ecb-4e88-8d5f-34201c9d4a77 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:36.732572 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5f731ded-0ecb-4e88-8d5f-34201c9d4a77 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1362 microversion: 2.1 time: 0.236754 Jul 11 21:05:36.734368 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 398/801] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:36 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:37.667193 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7336c97e-a1b1-488c-b36e-c66f7b5b360d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:37.667881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7336c97e-a1b1-488c-b36e-c66f7b5b360d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:37.674442 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7336c97e-a1b1-488c-b36e-c66f7b5b360d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:37.674949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7336c97e-a1b1-488c-b36e-c66f7b5b360d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:37.675790 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7336c97e-a1b1-488c-b36e-c66f7b5b360d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:37.676340 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7336c97e-a1b1-488c-b36e-c66f7b5b360d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:37.752778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5ca929be-0640-404e-8296-3f81936f77e5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:37.753399 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5ca929be-0640-404e-8296-3f81936f77e5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:37.761049 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5ca929be-0640-404e-8296-3f81936f77e5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:37.761488 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5ca929be-0640-404e-8296-3f81936f77e5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:37.762230 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5ca929be-0640-404e-8296-3f81936f77e5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:37.762830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5ca929be-0640-404e-8296-3f81936f77e5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:37.914901 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5ca929be-0640-404e-8296-3f81936f77e5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:37.924639 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5ca929be-0640-404e-8296-3f81936f77e5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1362 microversion: 2.1 time: 0.178077 Jul 11 21:05:37.925818 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 399/802] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:37 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:37.940524 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7336c97e-a1b1-488c-b36e-c66f7b5b360d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:37.953756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7336c97e-a1b1-488c-b36e-c66f7b5b360d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.290359 Jul 11 21:05:37.954725 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 404/803] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:37 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:38.941991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ac94a616-343b-4040-b571-768e4b937ce0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:38.942607 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ac94a616-343b-4040-b571-768e4b937ce0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:38.950673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ac94a616-343b-4040-b571-768e4b937ce0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:38.951124 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ac94a616-343b-4040-b571-768e4b937ce0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:38.952097 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ac94a616-343b-4040-b571-768e4b937ce0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:38.952727 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ac94a616-343b-4040-b571-768e4b937ce0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:38.972138 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-59390a82-a7bc-4c6f-a556-a70bef33eb34 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:38.972747 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-59390a82-a7bc-4c6f-a556-a70bef33eb34 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:38.982402 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-59390a82-a7bc-4c6f-a556-a70bef33eb34 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:38.983572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-59390a82-a7bc-4c6f-a556-a70bef33eb34 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:38.984380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-59390a82-a7bc-4c6f-a556-a70bef33eb34 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:38.985001 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-59390a82-a7bc-4c6f-a556-a70bef33eb34 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:39.128143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ac94a616-343b-4040-b571-768e4b937ce0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:39.133762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:39.138842 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ac94a616-343b-4040-b571-768e4b937ce0 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1362 microversion: 2.1 time: 0.200757 Jul 11 21:05:39.139516 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 400/804] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:38 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:39.274381 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-59390a82-a7bc-4c6f-a556-a70bef33eb34 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:39.284292 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-59390a82-a7bc-4c6f-a556-a70bef33eb34 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.315853 Jul 11 21:05:39.285205 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 405/805] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:38 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:40.159343 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8fc59c05-044e-4bc7-9498-611d46ea9299 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:40.160927 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8fc59c05-044e-4bc7-9498-611d46ea9299 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:40.175027 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fc59c05-044e-4bc7-9498-611d46ea9299 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:40.175479 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fc59c05-044e-4bc7-9498-611d46ea9299 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:40.176289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fc59c05-044e-4bc7-9498-611d46ea9299 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:40.176715 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fc59c05-044e-4bc7-9498-611d46ea9299 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:40.302437 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2f0069f7-d959-4f20-8b8b-d35a2a6dda57 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:40.303872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2f0069f7-d959-4f20-8b8b-d35a2a6dda57 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:40.312401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f0069f7-d959-4f20-8b8b-d35a2a6dda57 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:40.315056 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f0069f7-d959-4f20-8b8b-d35a2a6dda57 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:40.317196 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f0069f7-d959-4f20-8b8b-d35a2a6dda57 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:40.317621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f0069f7-d959-4f20-8b8b-d35a2a6dda57 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:40.381970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8fc59c05-044e-4bc7-9498-611d46ea9299 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:40.390303 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8fc59c05-044e-4bc7-9498-611d46ea9299 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1362 microversion: 2.1 time: 0.237200 Jul 11 21:05:40.391581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 401/806] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:40 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:40.488164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2f0069f7-d959-4f20-8b8b-d35a2a6dda57 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:40.496851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2f0069f7-d959-4f20-8b8b-d35a2a6dda57 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.198511 Jul 11 21:05:40.497510 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 406/807] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:40 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:40.576741 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f9d0e85c-e4a3-4f9d-aa06-d332452aa987 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: .version_select at 0x7f38400abee0>, body: {"keypair": {"name": "tempest-keypair-1590383589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/cqaxIVponSFKlDIFWj8NveB2r84o9aP1phcMQ4aS9/qHXE3BYVleLLGv+OVyY3acc7g4w/qi2b1LttwYzF5/daRpQ40kbKHc3dz8X9J7r3Emv9t2H6Q8C0qXs9f4pgA=="}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:40.591411 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-f9d0e85c-e4a3-4f9d-aa06-d332452aa987 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:05:40.595581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-f9d0e85c-e4a3-4f9d-aa06-d332452aa987 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for user 68f6997db7c141529c37cc64955df779 and project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:05:40.626464 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f9d0e85c-e4a3-4f9d-aa06-d332452aa987 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.203217 Jul 11 21:05:40.627072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 402/808] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 21:05:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:05:41.409290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f1a302ce-b2ae-4c19-9abc-fa228eb15c0e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:41.410526 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f1a302ce-b2ae-4c19-9abc-fa228eb15c0e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:41.417727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f1a302ce-b2ae-4c19-9abc-fa228eb15c0e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:41.418139 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f1a302ce-b2ae-4c19-9abc-fa228eb15c0e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:41.419128 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f1a302ce-b2ae-4c19-9abc-fa228eb15c0e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:41.419709 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f1a302ce-b2ae-4c19-9abc-fa228eb15c0e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:41.515518 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-42c7016d-4466-450d-bd2e-979783eacff7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:41.516175 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-42c7016d-4466-450d-bd2e-979783eacff7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:41.597280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f1a302ce-b2ae-4c19-9abc-fa228eb15c0e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:41.600011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:41.609642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f1a302ce-b2ae-4c19-9abc-fa228eb15c0e tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1362 microversion: 2.1 time: 0.204463 Jul 11 21:05:41.611283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 407/809] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:41 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:41.692285 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-42c7016d-4466-450d-bd2e-979783eacff7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:41.692865 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-42c7016d-4466-450d-bd2e-979783eacff7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:41.693889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-42c7016d-4466-450d-bd2e-979783eacff7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:41.694570 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-42c7016d-4466-450d-bd2e-979783eacff7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:41.804605 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-af3ba6b0-9a1b-4c50-828a-09b1ca31ac86 req-815e9a61-ce42-43b7-8aa1-699a2802c887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e2e88-f321-4be4-8030-ce7a59d27211", "name": "network-vif-plugged", "status": "completed", "tag": "1edf8c56-e0a4-46ea-a0ea-b8208cec4797"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:41.817886 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:41.820804 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-af3ba6b0-9a1b-4c50-828a-09b1ca31ac86 req-815e9a61-ce42-43b7-8aa1-699a2802c887 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:41.821443 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-af3ba6b0-9a1b-4c50-828a-09b1ca31ac86 req-815e9a61-ce42-43b7-8aa1-699a2802c887 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:41.847468 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=10 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:41.853024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-af3ba6b0-9a1b-4c50-828a-09b1ca31ac86 req-815e9a61-ce42-43b7-8aa1-699a2802c887 service nova] Creating event network-vif-plugged:1edf8c56-e0a4-46ea-a0ea-b8208cec4797 for instance 582e2e88-f321-4be4-8030-ce7a59d27211 on hv-cinder-84902 Jul 11 21:05:41.859302 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-af3ba6b0-9a1b-4c50-828a-09b1ca31ac86 req-815e9a61-ce42-43b7-8aa1-699a2802c887 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058545 Jul 11 21:05:41.859925 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 408/810] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:05:42.053952 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-42c7016d-4466-450d-bd2e-979783eacff7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:42.066962 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-42c7016d-4466-450d-bd2e-979783eacff7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.555699 Jul 11 21:05:42.079160 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 403/811] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:41 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:42.233957 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1915735005", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "681ae82c-3a6d-44f5-9bef-155f92884bde"}], "security_groups": [{"name": "tempest-securitygroup--1951604151"}], "key_name": "tempest-keypair-1590383589", "user_data": "}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:42.342651 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.network.neutron [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] validate_networks() for [('681ae82c-3a6d-44f5-9bef-155f92884bde', None, None, None, None, None)] {{(pid=118013) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:05:42.634325 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-207ea7dd-9c12-46de-bb50-173aeba0dabf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:42.635696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-207ea7dd-9c12-46de-bb50-173aeba0dabf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:42.642680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-207ea7dd-9c12-46de-bb50-173aeba0dabf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:42.643918 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-207ea7dd-9c12-46de-bb50-173aeba0dabf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:42.645005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-207ea7dd-9c12-46de-bb50-173aeba0dabf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:42.645600 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-207ea7dd-9c12-46de-bb50-173aeba0dabf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:42.835712 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Flavor limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:05:42.836716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Image limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:05:42.836861 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-207ea7dd-9c12-46de-bb50-173aeba0dabf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:42.837500 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Flavor pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:05:42.838064 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Image pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:05:42.838632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:05:42.846714 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-207ea7dd-9c12-46de-bb50-173aeba0dabf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1362 microversion: 2.1 time: 0.223159 Jul 11 21:05:42.847646 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 404/812] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:42 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:42.850192 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:42.850836 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:42.851633 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:42.852065 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:42.870843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:05:42.875176 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for user 68f6997db7c141529c37cc64955df779 and project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:05:42.887624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Going to run 1 instances... {{(pid=118013) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:05:42.890110 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118013) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:05:42.937500 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6eca2a8d-09ff-4742-b8cb-98c2892fc003 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.708240 Jul 11 21:05:42.938155 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 409/813] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:05:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:05:42.949886 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-29841f88-2248-49ac-af0d-d6985937df81 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:42.950823 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-29841f88-2248-49ac-af0d-d6985937df81 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:43.026467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-29841f88-2248-49ac-af0d-d6985937df81 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:43.035508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-29841f88-2248-49ac-af0d-d6985937df81 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1242 microversion: 2.1 time: 0.090467 Jul 11 21:05:43.036079 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 405/814] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:42 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:43.087200 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-21b9ad29-f070-4aa8-a239-0ec1e0ec0a1d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:43.088009 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-21b9ad29-f070-4aa8-a239-0ec1e0ec0a1d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:43.095183 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-21b9ad29-f070-4aa8-a239-0ec1e0ec0a1d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:43.095838 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-21b9ad29-f070-4aa8-a239-0ec1e0ec0a1d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:43.096855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-21b9ad29-f070-4aa8-a239-0ec1e0ec0a1d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:43.097275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-21b9ad29-f070-4aa8-a239-0ec1e0ec0a1d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:43.296391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-21b9ad29-f070-4aa8-a239-0ec1e0ec0a1d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:43.305669 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-21b9ad29-f070-4aa8-a239-0ec1e0ec0a1d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.224310 Jul 11 21:05:43.306249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 410/815] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:43 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:43.868049 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4b1f9d0b-ca2e-447f-885c-9ea132541aab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:43.869099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4b1f9d0b-ca2e-447f-885c-9ea132541aab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:43.877293 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b1f9d0b-ca2e-447f-885c-9ea132541aab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:43.877990 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b1f9d0b-ca2e-447f-885c-9ea132541aab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:43.878854 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b1f9d0b-ca2e-447f-885c-9ea132541aab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:43.879303 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4b1f9d0b-ca2e-447f-885c-9ea132541aab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:44.024880 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4b1f9d0b-ca2e-447f-885c-9ea132541aab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:44.035776 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4b1f9d0b-ca2e-447f-885c-9ea132541aab tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1547 microversion: 2.1 time: 0.175404 Jul 11 21:05:44.036409 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 406/816] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:43 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:44.053589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6f7119be-290c-4367-a1aa-301eb0f6e3bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:44.054130 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6f7119be-290c-4367-a1aa-301eb0f6e3bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:44.061112 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f7119be-290c-4367-a1aa-301eb0f6e3bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:44.061569 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f7119be-290c-4367-a1aa-301eb0f6e3bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:44.061734 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-298b786f-7d7f-4627-a24a-4812a040a188 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:44.062340 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f7119be-290c-4367-a1aa-301eb0f6e3bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:44.062719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-298b786f-7d7f-4627-a24a-4812a040a188 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:44.062861 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f7119be-290c-4367-a1aa-301eb0f6e3bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:44.069598 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-298b786f-7d7f-4627-a24a-4812a040a188 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:44.070326 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-298b786f-7d7f-4627-a24a-4812a040a188 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:44.071283 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-298b786f-7d7f-4627-a24a-4812a040a188 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:44.071716 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-298b786f-7d7f-4627-a24a-4812a040a188 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:44.147266 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-298b786f-7d7f-4627-a24a-4812a040a188 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:44.158130 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-298b786f-7d7f-4627-a24a-4812a040a188 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1294 microversion: 2.1 time: 0.100087 Jul 11 21:05:44.158853 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 407/817] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:44 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:44.169158 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6f7119be-290c-4367-a1aa-301eb0f6e3bc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120418 Jul 11 21:05:44.169835 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 411/818] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jul 11 21:05:44 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:44.323456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2a83f39d-5c49-436e-b91d-129ee252940a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:44.324062 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2a83f39d-5c49-436e-b91d-129ee252940a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:44.330157 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a83f39d-5c49-436e-b91d-129ee252940a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:44.330597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a83f39d-5c49-436e-b91d-129ee252940a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:44.331353 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a83f39d-5c49-436e-b91d-129ee252940a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:44.331779 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a83f39d-5c49-436e-b91d-129ee252940a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:44.480326 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2a83f39d-5c49-436e-b91d-129ee252940a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:44.490829 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2a83f39d-5c49-436e-b91d-129ee252940a tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.171183 Jul 11 21:05:44.500472 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 408/819] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:44 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:05:45.137152 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-59efd60b-fd69-4274-9b13-16c164008fdf req-d43a002a-6136-4ce4-aa1d-79dab8738f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582e2e88-f321-4be4-8030-ce7a59d27211", "tag": "1edf8c56-e0a4-46ea-a0ea-b8208cec4797"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:45.145473 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-59efd60b-fd69-4274-9b13-16c164008fdf req-d43a002a-6136-4ce4-aa1d-79dab8738f9f service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:45.145916 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-59efd60b-fd69-4274-9b13-16c164008fdf req-d43a002a-6136-4ce4-aa1d-79dab8738f9f service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:45.157952 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-59efd60b-fd69-4274-9b13-16c164008fdf req-d43a002a-6136-4ce4-aa1d-79dab8738f9f service nova] Creating event network-changed:1edf8c56-e0a4-46ea-a0ea-b8208cec4797 for instance 582e2e88-f321-4be4-8030-ce7a59d27211 on hv-cinder-84902 Jul 11 21:05:45.163987 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-59efd60b-fd69-4274-9b13-16c164008fdf req-d43a002a-6136-4ce4-aa1d-79dab8738f9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030500 Jul 11 21:05:45.165303 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 412/820] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:45.177133 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e4c69937-f396-48ac-8815-1eff3298e344 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:45.177990 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e4c69937-f396-48ac-8815-1eff3298e344 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:45.185062 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e4c69937-f396-48ac-8815-1eff3298e344 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:45.185631 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e4c69937-f396-48ac-8815-1eff3298e344 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:45.186611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e4c69937-f396-48ac-8815-1eff3298e344 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:45.187135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e4c69937-f396-48ac-8815-1eff3298e344 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:45.298305 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e4c69937-f396-48ac-8815-1eff3298e344 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:45.307858 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e4c69937-f396-48ac-8815-1eff3298e344 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1300 microversion: 2.1 time: 0.135710 Jul 11 21:05:45.308589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 409/821] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:45 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:45.511076 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a475d96a-d5ae-4b38-8ef8-c814a3203b3e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:45.511973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a475d96a-d5ae-4b38-8ef8-c814a3203b3e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:45.520738 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a475d96a-d5ae-4b38-8ef8-c814a3203b3e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:45.521998 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a475d96a-d5ae-4b38-8ef8-c814a3203b3e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:45.523022 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a475d96a-d5ae-4b38-8ef8-c814a3203b3e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:45.523629 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a475d96a-d5ae-4b38-8ef8-c814a3203b3e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:45.723811 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a475d96a-d5ae-4b38-8ef8-c814a3203b3e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:45.733792 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a475d96a-d5ae-4b38-8ef8-c814a3203b3e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.228759 Jul 11 21:05:45.744687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 413/822] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:45 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:46.326035 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8d9c127e-b11f-45f1-8341-92f5f56a83e3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:46.327224 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8d9c127e-b11f-45f1-8341-92f5f56a83e3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:46.335421 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d9c127e-b11f-45f1-8341-92f5f56a83e3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:46.336081 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d9c127e-b11f-45f1-8341-92f5f56a83e3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:46.337063 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d9c127e-b11f-45f1-8341-92f5f56a83e3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:46.337659 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d9c127e-b11f-45f1-8341-92f5f56a83e3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:46.566095 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8d9c127e-b11f-45f1-8341-92f5f56a83e3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:46.573978 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8d9c127e-b11f-45f1-8341-92f5f56a83e3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1368 microversion: 2.1 time: 0.252117 Jul 11 21:05:46.574550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 410/823] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:46 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:46.679011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-8d860aea-e80b-438b-95c7-68ca50fffa6a req-fb60d721-e527-4c64-94a0-9ca9011520cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a34d34e-5069-4a9b-bd8e-aee28a2e4668", "tag": "72f6522e-b9a9-4ae8-bdf6-f69ca8c66521"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:46.688895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-8d860aea-e80b-438b-95c7-68ca50fffa6a req-fb60d721-e527-4c64-94a0-9ca9011520cb service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:46.689411 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-8d860aea-e80b-438b-95c7-68ca50fffa6a req-fb60d721-e527-4c64-94a0-9ca9011520cb service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:46.702439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-8d860aea-e80b-438b-95c7-68ca50fffa6a req-fb60d721-e527-4c64-94a0-9ca9011520cb service nova] Creating event network-changed:72f6522e-b9a9-4ae8-bdf6-f69ca8c66521 for instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 on hv-cinder-84902 Jul 11 21:05:46.707413 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-8d860aea-e80b-438b-95c7-68ca50fffa6a req-fb60d721-e527-4c64-94a0-9ca9011520cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032209 Jul 11 21:05:46.708020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 414/824] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:46.752305 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ff6e3c87-6886-40f0-8814-dccac1a7e7f6 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:46.752600 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ff6e3c87-6886-40f0-8814-dccac1a7e7f6 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:46.759668 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ff6e3c87-6886-40f0-8814-dccac1a7e7f6 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:46.760503 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ff6e3c87-6886-40f0-8814-dccac1a7e7f6 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:46.761253 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ff6e3c87-6886-40f0-8814-dccac1a7e7f6 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:46.761881 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ff6e3c87-6886-40f0-8814-dccac1a7e7f6 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:47.262265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ff6e3c87-6886-40f0-8814-dccac1a7e7f6 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:47.270751 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ff6e3c87-6886-40f0-8814-dccac1a7e7f6 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.522718 Jul 11 21:05:47.271376 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 411/825] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:46 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:47.596661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ca4d1d2f-c51d-4dd8-9ce8-de897843b997 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:47.597384 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ca4d1d2f-c51d-4dd8-9ce8-de897843b997 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:47.599980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:47.606500 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ca4d1d2f-c51d-4dd8-9ce8-de897843b997 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:47.606968 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ca4d1d2f-c51d-4dd8-9ce8-de897843b997 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:47.607757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ca4d1d2f-c51d-4dd8-9ce8-de897843b997 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:47.608159 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ca4d1d2f-c51d-4dd8-9ce8-de897843b997 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:47.751293 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ca4d1d2f-c51d-4dd8-9ce8-de897843b997 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:47.759756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ca4d1d2f-c51d-4dd8-9ce8-de897843b997 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1368 microversion: 2.1 time: 0.171381 Jul 11 21:05:47.760277 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 415/826] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:47 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:48.291943 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cd8525b2-1094-40a4-8e37-d55c0e74b2aa tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:48.292882 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cd8525b2-1094-40a4-8e37-d55c0e74b2aa tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:48.303072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cd8525b2-1094-40a4-8e37-d55c0e74b2aa tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:48.303520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cd8525b2-1094-40a4-8e37-d55c0e74b2aa tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:48.304421 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cd8525b2-1094-40a4-8e37-d55c0e74b2aa tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:48.304854 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cd8525b2-1094-40a4-8e37-d55c0e74b2aa tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:48.460409 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cd8525b2-1094-40a4-8e37-d55c0e74b2aa tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:48.468968 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cd8525b2-1094-40a4-8e37-d55c0e74b2aa tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.183266 Jul 11 21:05:48.469548 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 412/827] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:48 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:48.778025 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-67e24df9-af88-45ce-8119-4237772164e0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:48.778630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-67e24df9-af88-45ce-8119-4237772164e0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:48.785561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-67e24df9-af88-45ce-8119-4237772164e0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:48.786005 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-67e24df9-af88-45ce-8119-4237772164e0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:48.786757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-67e24df9-af88-45ce-8119-4237772164e0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:48.787409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-67e24df9-af88-45ce-8119-4237772164e0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:48.918412 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-67e24df9-af88-45ce-8119-4237772164e0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:48.926450 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-67e24df9-af88-45ce-8119-4237772164e0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1368 microversion: 2.1 time: 0.152394 Jul 11 21:05:48.927027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 416/828] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:48 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:49.489998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9b4ade92-d6bd-4981-b546-ca244591e9ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:49.491314 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9b4ade92-d6bd-4981-b546-ca244591e9ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:49.502183 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9b4ade92-d6bd-4981-b546-ca244591e9ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:49.502933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9b4ade92-d6bd-4981-b546-ca244591e9ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:49.504213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9b4ade92-d6bd-4981-b546-ca244591e9ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:49.504960 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9b4ade92-d6bd-4981-b546-ca244591e9ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:49.660603 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9b4ade92-d6bd-4981-b546-ca244591e9ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:49.675295 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9b4ade92-d6bd-4981-b546-ca244591e9ae tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.191875 Jul 11 21:05:49.675872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 413/829] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:49 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:49.947376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a6031b34-02d8-4387-b440-8f84e2057afc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:49.948482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a6031b34-02d8-4387-b440-8f84e2057afc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:49.958775 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6031b34-02d8-4387-b440-8f84e2057afc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:49.959821 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6031b34-02d8-4387-b440-8f84e2057afc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:49.960627 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6031b34-02d8-4387-b440-8f84e2057afc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:49.961073 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6031b34-02d8-4387-b440-8f84e2057afc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:50.100905 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a6031b34-02d8-4387-b440-8f84e2057afc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:50.108528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a6031b34-02d8-4387-b440-8f84e2057afc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1368 microversion: 2.1 time: 0.167978 Jul 11 21:05:50.109113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 417/830] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:49 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:50.693784 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-136a64e1-679e-4d26-a2bc-7495a2a29d37 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:50.694489 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-136a64e1-679e-4d26-a2bc-7495a2a29d37 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:50.701711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-136a64e1-679e-4d26-a2bc-7495a2a29d37 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:50.702180 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-136a64e1-679e-4d26-a2bc-7495a2a29d37 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:50.702980 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-136a64e1-679e-4d26-a2bc-7495a2a29d37 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:50.703442 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-136a64e1-679e-4d26-a2bc-7495a2a29d37 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:50.855953 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-136a64e1-679e-4d26-a2bc-7495a2a29d37 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:50.864072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-136a64e1-679e-4d26-a2bc-7495a2a29d37 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.174570 Jul 11 21:05:50.864672 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 414/831] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:50 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:51.129677 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-425a224f-d054-4590-a948-ec104c471ab8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:51.130678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-425a224f-d054-4590-a948-ec104c471ab8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:51.145032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-425a224f-d054-4590-a948-ec104c471ab8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:51.145780 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-425a224f-d054-4590-a948-ec104c471ab8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:51.147045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-425a224f-d054-4590-a948-ec104c471ab8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:51.147771 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-425a224f-d054-4590-a948-ec104c471ab8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:51.293898 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-425a224f-d054-4590-a948-ec104c471ab8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:51.302636 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-425a224f-d054-4590-a948-ec104c471ab8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1368 microversion: 2.1 time: 0.179458 Jul 11 21:05:51.303216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 418/832] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:51 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:51.887544 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1c9a7166-5c88-47c7-a60d-42c240d30c00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:51.888338 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1c9a7166-5c88-47c7-a60d-42c240d30c00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:51.894391 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1c9a7166-5c88-47c7-a60d-42c240d30c00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:51.894855 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1c9a7166-5c88-47c7-a60d-42c240d30c00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:51.895612 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1c9a7166-5c88-47c7-a60d-42c240d30c00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:51.896044 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1c9a7166-5c88-47c7-a60d-42c240d30c00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:52.055189 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1c9a7166-5c88-47c7-a60d-42c240d30c00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:52.071590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1c9a7166-5c88-47c7-a60d-42c240d30c00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1757 microversion: 2.1 time: 0.188160 Jul 11 21:05:52.072238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 415/833] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:51 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:52.324028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-84d77359-1162-4279-a466-65087c12843c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:52.324606 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-84d77359-1162-4279-a466-65087c12843c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:52.331338 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-84d77359-1162-4279-a466-65087c12843c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:52.331788 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-84d77359-1162-4279-a466-65087c12843c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:52.332582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-84d77359-1162-4279-a466-65087c12843c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:52.333019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-84d77359-1162-4279-a466-65087c12843c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:52.468484 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-84d77359-1162-4279-a466-65087c12843c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:52.477067 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-84d77359-1162-4279-a466-65087c12843c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1368 microversion: 2.1 time: 0.156553 Jul 11 21:05:52.477669 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 419/834] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:52 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:53.091647 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d706ad28-41a9-4739-91de-805803c48e00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:53.092299 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d706ad28-41a9-4739-91de-805803c48e00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:53.094704 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=8 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:53.099983 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d706ad28-41a9-4739-91de-805803c48e00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:53.100441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d706ad28-41a9-4739-91de-805803c48e00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:53.101344 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d706ad28-41a9-4739-91de-805803c48e00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:53.101786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d706ad28-41a9-4739-91de-805803c48e00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:53.261890 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d706ad28-41a9-4739-91de-805803c48e00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:53.274332 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d706ad28-41a9-4739-91de-805803c48e00 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1760 microversion: 2.1 time: 0.187332 Jul 11 21:05:53.275185 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 416/835] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:53 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:53.498245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-476a42d9-fb30-4cbb-b1b2-eeefe0bba59b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:53.499311 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-476a42d9-fb30-4cbb-b1b2-eeefe0bba59b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:53.502387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:53.503415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=6 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:53.513731 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-476a42d9-fb30-4cbb-b1b2-eeefe0bba59b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:53.514420 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-476a42d9-fb30-4cbb-b1b2-eeefe0bba59b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:53.515583 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-476a42d9-fb30-4cbb-b1b2-eeefe0bba59b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:53.516346 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-476a42d9-fb30-4cbb-b1b2-eeefe0bba59b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:53.652275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-476a42d9-fb30-4cbb-b1b2-eeefe0bba59b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:53.661830 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-476a42d9-fb30-4cbb-b1b2-eeefe0bba59b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1368 microversion: 2.1 time: 0.170286 Jul 11 21:05:53.662405 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 420/836] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:53 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:53.841805 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-69d36f00-cc5d-4389-8800-7a602e7bbeb4 req-ad758642-7581-4481-b42b-ffd303808f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a34d34e-5069-4a9b-bd8e-aee28a2e4668", "name": "network-vif-plugged", "status": "completed", "tag": "72f6522e-b9a9-4ae8-bdf6-f69ca8c66521"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:53.858377 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-69d36f00-cc5d-4389-8800-7a602e7bbeb4 req-ad758642-7581-4481-b42b-ffd303808f49 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:53.858821 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-69d36f00-cc5d-4389-8800-7a602e7bbeb4 req-ad758642-7581-4481-b42b-ffd303808f49 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:53.870371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-69d36f00-cc5d-4389-8800-7a602e7bbeb4 req-ad758642-7581-4481-b42b-ffd303808f49 service nova] Creating event network-vif-plugged:72f6522e-b9a9-4ae8-bdf6-f69ca8c66521 for instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 on hv-cinder-84902 Jul 11 21:05:53.875519 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-69d36f00-cc5d-4389-8800-7a602e7bbeb4 req-ad758642-7581-4481-b42b-ffd303808f49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042528 Jul 11 21:05:53.876509 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 417/837] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:54.679162 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-30721a93-24be-4fc5-9850-d49bbb1fb679 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:54.679702 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-30721a93-24be-4fc5-9850-d49bbb1fb679 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:54.686283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30721a93-24be-4fc5-9850-d49bbb1fb679 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:54.686722 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30721a93-24be-4fc5-9850-d49bbb1fb679 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:54.687480 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30721a93-24be-4fc5-9850-d49bbb1fb679 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:54.687905 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-30721a93-24be-4fc5-9850-d49bbb1fb679 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:54.832276 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-30721a93-24be-4fc5-9850-d49bbb1fb679 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:54.840596 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-30721a93-24be-4fc5-9850-d49bbb1fb679 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1368 microversion: 2.1 time: 0.165444 Jul 11 21:05:54.841178 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 421/838] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:54 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:55.858736 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c9183b88-9d17-4c4b-81b0-7dd844ab440e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:55.859452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c9183b88-9d17-4c4b-81b0-7dd844ab440e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:55.861443 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:05:55.867642 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c9183b88-9d17-4c4b-81b0-7dd844ab440e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:55.868088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c9183b88-9d17-4c4b-81b0-7dd844ab440e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:55.868870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c9183b88-9d17-4c4b-81b0-7dd844ab440e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:55.869406 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c9183b88-9d17-4c4b-81b0-7dd844ab440e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:56.004349 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c9183b88-9d17-4c4b-81b0-7dd844ab440e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:05:56.012398 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c9183b88-9d17-4c4b-81b0-7dd844ab440e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1559 microversion: 2.1 time: 0.158476 Jul 11 21:05:56.013012 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 418/839] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:05:55 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:05:56.037891 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-65b28c92-b1a5-4b0e-8bbc-f059b045c4c2 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:05:56.038716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-65b28c92-b1a5-4b0e-8bbc-f059b045c4c2 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:05:56.046038 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-65b28c92-b1a5-4b0e-8bbc-f059b045c4c2 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:56.046482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-65b28c92-b1a5-4b0e-8bbc-f059b045c4c2 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:56.047234 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-65b28c92-b1a5-4b0e-8bbc-f059b045c4c2 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:56.047659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-65b28c92-b1a5-4b0e-8bbc-f059b045c4c2 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:56.126051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-65b28c92-b1a5-4b0e-8bbc-f059b045c4c2 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094500 Jul 11 21:05:56.126673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 422/840] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jul 11 21:05:56 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:05:57.383913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-89b1bd79-f76e-4a82-b314-94d24452b717 req-54b1e481-539c-479f-bf6d-8441a598de3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a34d34e-5069-4a9b-bd8e-aee28a2e4668", "tag": "72f6522e-b9a9-4ae8-bdf6-f69ca8c66521"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:05:57.393066 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-89b1bd79-f76e-4a82-b314-94d24452b717 req-54b1e481-539c-479f-bf6d-8441a598de3c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:05:57.393508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-89b1bd79-f76e-4a82-b314-94d24452b717 req-54b1e481-539c-479f-bf6d-8441a598de3c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:05:57.405020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-89b1bd79-f76e-4a82-b314-94d24452b717 req-54b1e481-539c-479f-bf6d-8441a598de3c service nova] Creating event network-changed:72f6522e-b9a9-4ae8-bdf6-f69ca8c66521 for instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 on hv-cinder-84902 Jul 11 21:05:57.410034 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-89b1bd79-f76e-4a82-b314-94d24452b717 req-54b1e481-539c-479f-bf6d-8441a598de3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029849 Jul 11 21:05:57.410995 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 419/841] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:06:14.980702 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=15 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:14.981872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=71 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:14.988393 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d8a4fd13-87bf-4974-ac66-befcbfc1da13 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:14.989180 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d8a4fd13-87bf-4974-ac66-befcbfc1da13 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:14.999370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d8a4fd13-87bf-4974-ac66-befcbfc1da13 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:14.999807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d8a4fd13-87bf-4974-ac66-befcbfc1da13 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:15.000589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d8a4fd13-87bf-4974-ac66-befcbfc1da13 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:15.001014 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d8a4fd13-87bf-4974-ac66-befcbfc1da13 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:15.023855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d8a4fd13-87bf-4974-ac66-befcbfc1da13 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/ips" status: 200 len: 151 microversion: 2.20 time: 0.044928 Jul 11 21:06:15.024449 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 423/842] 10.222.0.20 () {60 vars in 1288 bytes} [Mon Jul 11 21:06:14 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 21:06:16.907725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:16.908698 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=95 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:16.915091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-973696ec-2e06-40a5-ab18-1ddd2c96853b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:06:16.916037 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-973696ec-2e06-40a5-ab18-1ddd2c96853b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:16.925143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-973696ec-2e06-40a5-ab18-1ddd2c96853b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:16.925517 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-973696ec-2e06-40a5-ab18-1ddd2c96853b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:16.926267 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-973696ec-2e06-40a5-ab18-1ddd2c96853b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:16.926690 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-973696ec-2e06-40a5-ab18-1ddd2c96853b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:16.948986 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-973696ec-2e06-40a5-ab18-1ddd2c96853b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lazy-loading 'flavor' on Instance uuid 169a98b1-4200-4917-86bd-62e3581530f0 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:06:17.218860 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-973696ec-2e06-40a5-ab18-1ddd2c96853b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/action" status: 202 len: 0 microversion: 2.20 time: 0.314752 Jul 11 21:06:17.219494 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 420/843] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jul 11 21:06:16 2022] POST /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:06:17.229055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:17.229642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:17.236164 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:17.236645 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:17.237399 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:17.237818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:17.371598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:17.380316 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:17.381821 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:17.382969 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a295703c-ecd2-4025-a9d8-4406f456bf66 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.157995 Jul 11 21:06:17.383539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 424/844] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:17 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:18.407772 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:18.408612 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:18.418673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:18.419367 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:18.420720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:18.421175 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:18.564675 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:18.573238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:18.574732 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:18.575934 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-10de1cc8-a6b9-4c86-9f01-e73de433841d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.176318 Jul 11 21:06:18.576526 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 421/845] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:18 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:19.599040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:19.600038 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:19.612975 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:19.613713 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:19.614964 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:19.615678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:19.757997 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:19.766595 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:19.768061 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:19.769230 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-58442bbe-33c7-4aa7-b5d8-e0a3daf83763 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.176813 Jul 11 21:06:19.769767 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 425/846] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:19 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:20.795538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:20.796860 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:20.804617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:20.805090 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:20.805887 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:20.806342 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:20.942655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:20.951297 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:20.953119 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:20.954406 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a6f6002e-def8-43df-a07e-e3d224477fe0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.165561 Jul 11 21:06:20.954970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 422/847] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:20 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:21.976561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:21.977575 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:21.988401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:21.989156 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:21.990388 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:21.991158 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:22.134174 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:22.145232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:22.146727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:22.147886 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fc9fb8ab-fd29-4f53-aafa-73b8e3e36e32 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.178007 Jul 11 21:06:22.148497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 426/848] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:21 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:23.170391 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:23.171401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:23.183207 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:23.183950 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:23.185390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:23.186094 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:23.323016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:23.331487 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:23.333007 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:23.334166 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4dd4c800-5cad-4329-847a-2361fee50d12 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.170338 Jul 11 21:06:23.334694 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 423/849] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:23 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:24.357187 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:24.358179 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:24.365501 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:24.365947 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:24.366708 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:24.367223 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:24.502425 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:24.514515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:24.516736 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:24.517885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-898abde5-636a-4d17-bf95-1b8827d94195 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.167310 Jul 11 21:06:24.518451 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 427/850] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:24 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:25.542453 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:25.543044 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:25.550312 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:25.550758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:25.551521 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:25.551951 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:25.693471 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:25.701789 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:25.703249 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:25.704458 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-67bf3616-65e2-4832-9d8b-add65d70cc59 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.166377 Jul 11 21:06:25.705270 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 424/851] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:25 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:26.723036 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:26.723640 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:26.730396 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:26.731003 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:26.731810 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:26.732305 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:26.868693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:26.879136 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:26.880653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:26.881796 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-bfe084b9-813c-4e9d-a6b5-6ba6bc66d61d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.162873 Jul 11 21:06:26.882353 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 428/852] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:26 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:27.904804 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:27.905812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:27.913744 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:27.914199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:27.915246 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:27.915685 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:28.048099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:28.056504 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:28.058013 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:28.059187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-00ccb002-6647-4d0a-a86e-3f64a0fffa82 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.161275 Jul 11 21:06:28.059730 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 425/853] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:27 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:29.084018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:29.084701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:29.091105 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:29.091550 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:29.092360 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:29.092794 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:29.232152 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:29.240555 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:29.242038 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:29.243186 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-94f6175d-e9a0-49fa-b16d-1a2518329c5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.163299 Jul 11 21:06:29.243752 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 429/854] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:29 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:30.262038 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:30.262744 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:30.270339 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:30.270801 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:30.271567 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:30.271985 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:30.416375 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:30.424902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:30.426388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:30.427569 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5995dffe-d88c-40ab-97b9-b394d3bffcf2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.170139 Jul 11 21:06:30.428142 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 426/855] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:30 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:31.446171 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:31.446771 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:31.453173 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:31.453609 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:31.454366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:31.454865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:31.593367 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:31.603279 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:31.604823 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:31.605996 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ad373251-1847-427a-91e4-5d2ec7f03c72 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.163794 Jul 11 21:06:31.606566 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 430/856] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:31 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:32.625348 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:32.626699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:32.633723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:32.634252 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:32.635091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:32.635603 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:32.795889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:32.804507 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:32.805999 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:32.807155 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-df86ceee-63ac-495b-a5e4-eb55c662edc5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.185781 Jul 11 21:06:32.807690 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 427/857] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:32 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:33.829334 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:33.830795 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:33.841149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:33.841947 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:33.843226 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:33.843936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:33.980818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:33.989090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:33.990564 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:33.991712 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6610ddc0-c561-4979-b0e8-1dc2569900a4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.169021 Jul 11 21:06:33.992306 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 431/858] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:33 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:35.014504 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:35.015512 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:35.023515 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:35.023990 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:35.024795 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:35.025229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:35.176441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:35.184686 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:35.186161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:35.187317 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2cdc3688-fd25-411b-9626-4d5a2626c4a3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1743 microversion: 2.20 time: 0.179523 Jul 11 21:06:35.187876 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 428/859] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:35 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:36.206167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:36.206837 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:36.213293 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:36.213735 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:36.214497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:36.214933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:36.351801 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:36.359776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:36.361392 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:36.362584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-25a737d6-fc3f-46db-a7a8-68b91b0b8448 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1743 microversion: 2.20 time: 0.160546 Jul 11 21:06:36.363154 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 432/860] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:36 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:37.383575 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:37.384519 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:37.394112 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:37.394737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:37.395821 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:37.396584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:37.535592 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:37.544613 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:37.546122 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:37.547293 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e0ba0be0-423d-4cbf-9e5a-3dd927e144c2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1743 microversion: 2.20 time: 0.169440 Jul 11 21:06:37.548258 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 429/861] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:37 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:38.047106 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-14a43416-d873-4efd-82c1-9d18e4215e31 req-d06aef01-4ffc-4f84-b0c6-3697a92871d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169a98b1-4200-4917-86bd-62e3581530f0", "name": "network-vif-plugged", "status": "completed", "tag": "744bb15f-623b-4153-b111-d80b7f202ffc"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:06:38.058193 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-14a43416-d873-4efd-82c1-9d18e4215e31 req-d06aef01-4ffc-4f84-b0c6-3697a92871d1 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:38.058971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-14a43416-d873-4efd-82c1-9d18e4215e31 req-d06aef01-4ffc-4f84-b0c6-3697a92871d1 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:38.072097 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-14a43416-d873-4efd-82c1-9d18e4215e31 req-d06aef01-4ffc-4f84-b0c6-3697a92871d1 service nova] Creating event network-vif-plugged:744bb15f-623b-4153-b111-d80b7f202ffc for instance 169a98b1-4200-4917-86bd-62e3581530f0 on hv-cinder-84902 Jul 11 21:06:38.077339 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-14a43416-d873-4efd-82c1-9d18e4215e31 req-d06aef01-4ffc-4f84-b0c6-3697a92871d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033991 Jul 11 21:06:38.078177 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 433/862] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:06:38.570463 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:38.571427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:38.582786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:38.583231 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:38.583988 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:38.584448 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:38.739752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:38.749017 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:38.750727 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:38.751905 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-07a91f80-dde4-4017-a227-ae46c1a8290a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1743 microversion: 2.20 time: 0.188441 Jul 11 21:06:38.752506 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 430/863] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:38 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:39.775120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:39.776273 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:39.786564 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:39.787003 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:39.787753 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:39.788219 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:39.923842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:39.933313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:39.935100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:39.936259 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b52b3485-5eab-41c4-a2b9-a948a2afb916 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1743 microversion: 2.20 time: 0.168235 Jul 11 21:06:39.936860 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 434/864] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:39 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:40.958718 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:40.959316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:40.966145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:40.966589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:40.967346 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:40.967771 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:41.107636 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:41.115719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:41.117269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:41.118402 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-635479d0-af53-4b00-a2ba-a82c2f1ec82f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1743 microversion: 2.20 time: 0.166028 Jul 11 21:06:41.118941 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 431/865] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:40 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:42.137329 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:42.138033 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:42.146655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:42.147385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:42.148354 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:42.148839 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:42.291300 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:42.301540 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:42.305532 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:42.306894 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b6068676-1e1a-4c01-b2dc-6a6d547e37f4 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1738 microversion: 2.20 time: 0.173492 Jul 11 21:06:42.307912 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 435/866] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:42 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:43.326394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:43.327240 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:43.335145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:43.335667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:43.336661 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:43.337538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:43.496407 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:43.504687 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:43.506187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:43.507360 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-be31a95a-3e69-4797-b87e-711a5e7d0744 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1738 microversion: 2.20 time: 0.185009 Jul 11 21:06:43.507928 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 432/867] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:43 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:44.526892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:44.528154 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:44.535052 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:44.535505 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:44.536295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:44.536756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:44.695975 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:44.704758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:44.706234 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:44.707437 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6464c8fa-6a18-4d0f-a74a-2c5f61c40002 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1738 microversion: 2.20 time: 0.185460 Jul 11 21:06:44.707978 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 436/868] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:44 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:45.726478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:45.727107 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:45.733888 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:45.734332 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:45.735099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:45.735526 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:45.878176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:45.887981 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:45.889590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:45.890840 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f04ba93e-e0bb-401d-93f3-a497319ee8d2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1738 microversion: 2.20 time: 0.168567 Jul 11 21:06:45.891810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 433/869] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:45 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:46.909679 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:46.910261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:46.912591 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=29 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:46.918316 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:46.918767 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:46.919813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:46.920274 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:46.924334 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=79 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:47.060673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:47.069121 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:47.070629 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:47.071794 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-33a6026f-ccd8-4d20-a45b-c7e66156d0e5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1738 microversion: 2.20 time: 0.166259 Jul 11 21:06:47.077762 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 437/870] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:46 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:48.099547 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:48.100184 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:48.102832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=29 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:48.112710 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:48.114010 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:48.119261 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:48.121054 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:48.127016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:48.291747 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:48.301515 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:48.303484 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:48.305249 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-52fa314f-cf64-4d9c-ba6c-62d56ca7c182 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1738 microversion: 2.20 time: 0.218413 Jul 11 21:06:48.305814 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 434/871] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:48 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:49.327952 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:49.328684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:49.336046 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:49.336612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:49.337456 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:49.337961 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:49.482847 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:49.491495 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:49.493005 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:49.494174 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-70e26ba2-fa61-4cb2-9558-75007e188ae5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1738 microversion: 2.20 time: 0.172615 Jul 11 21:06:49.494721 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 438/872] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:49 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:50.514316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:50.515010 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:50.522637 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:50.523091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:50.523888 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:50.528370 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:50.698709 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:50.707319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:50.708893 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:50.712388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e339e92c-7203-4301-bcd0-24c734c79dd5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1738 microversion: 2.20 time: 0.202343 Jul 11 21:06:50.723003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 435/873] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:50 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:51.734946 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:51.735899 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:51.746423 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:51.747160 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:51.748491 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:51.749195 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:51.885596 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:51.893948 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:51.895501 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:51.896637 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6fab13f8-049e-431f-bb01-872f1de22e21 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1738 microversion: 2.20 time: 0.168374 Jul 11 21:06:51.897197 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 439/874] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:51 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:52.916897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:52.917897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:52.927752 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:52.928229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:52.928999 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:52.929426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:53.105521 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:53.113952 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:53.116305 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:53.117482 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-3dd2af1a-3aa6-41dd-961d-1a6673409322 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1720 microversion: 2.20 time: 0.206307 Jul 11 21:06:53.118053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 436/875] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:52 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:54.140542 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:54.141476 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:54.151835 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:54.152621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:54.153862 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:54.154584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:54.307147 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:54.315509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:54.317065 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:54.318313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-07ca7d18-e5ab-4648-9627-d09fc0a0cecc tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1720 microversion: 2.20 time: 0.184421 Jul 11 21:06:54.318910 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 440/876] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:54 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:55.342768 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:55.343535 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:55.350295 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:55.350934 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:55.351734 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:55.352259 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:55.492125 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:55.500801 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:55.502298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:55.503447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-94eb9330-7f58-4c49-94fe-bc3ea4143c2b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1663 microversion: 2.20 time: 0.164763 Jul 11 21:06:55.504011 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 437/877] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:55 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:55.521248 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0cee325d-79c3-4208-89b2-d70cbaa49d85 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fae2d158-a50a-4186-b9bc-d73b5e09961f"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:06:55.522336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0cee325d-79c3-4208-89b2-d70cbaa49d85 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:55.528695 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0cee325d-79c3-4208-89b2-d70cbaa49d85 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:55.529143 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0cee325d-79c3-4208-89b2-d70cbaa49d85 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:55.529901 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0cee325d-79c3-4208-89b2-d70cbaa49d85 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:55.530335 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0cee325d-79c3-4208-89b2-d70cbaa49d85 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:55.858219 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0cee325d-79c3-4208-89b2-d70cbaa49d85 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341027 Jul 11 21:06:55.858861 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 441/878] 10.222.0.20 () {62 vars in 1363 bytes} [Mon Jul 11 21:06:55 2022] POST /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/os-volume_attachments => generated 188 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 21:06:55.977618 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-746edbfa-1a04-45f3-8fc3-559760468fda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:55.978101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-746edbfa-1a04-45f3-8fc3-559760468fda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:55.985453 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-746edbfa-1a04-45f3-8fc3-559760468fda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:55.985910 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-746edbfa-1a04-45f3-8fc3-559760468fda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:55.986689 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-746edbfa-1a04-45f3-8fc3-559760468fda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:55.987121 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-746edbfa-1a04-45f3-8fc3-559760468fda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:56.092543 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-6e5e6da1-0317-4e40-89b5-0484cc1f1d72 req-ed33fd97-7a93-46bf-b840-1cbcc618e226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169a98b1-4200-4917-86bd-62e3581530f0", "name": "network-vif-unplugged", "status": "completed", "tag": "744bb15f-623b-4153-b111-d80b7f202ffc"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:06:56.101065 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-6e5e6da1-0317-4e40-89b5-0484cc1f1d72 req-ed33fd97-7a93-46bf-b840-1cbcc618e226 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:56.101630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-6e5e6da1-0317-4e40-89b5-0484cc1f1d72 req-ed33fd97-7a93-46bf-b840-1cbcc618e226 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:56.113662 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.compute.server_external_events [req-6e5e6da1-0317-4e40-89b5-0484cc1f1d72 req-ed33fd97-7a93-46bf-b840-1cbcc618e226 service nova] Unable to find a host for instance 169a98b1-4200-4917-86bd-62e3581530f0. Dropping event network-vif-unplugged {{(pid=118013) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 21:06:56.114538 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-6e5e6da1-0317-4e40-89b5-0484cc1f1d72 req-ed33fd97-7a93-46bf-b840-1cbcc618e226 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025865 Jul 11 21:06:56.115127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 442/879] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 11 21:06:56.244225 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-746edbfa-1a04-45f3-8fc3-559760468fda tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "DELETE /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/os-volume_attachments/fae2d158-a50a-4186-b9bc-d73b5e09961f" status: 202 len: 0 microversion: 2.20 time: 0.270545 Jul 11 21:06:56.244831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 438/880] 10.222.0.20 () {60 vars in 1456 bytes} [Mon Jul 11 21:06:55 2022] DELETE /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/os-volume_attachments/fae2d158-a50a-4186-b9bc-d73b5e09961f => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:06:56.301813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6d038b50-e03e-491b-9a74-b92f86b5c04a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:06:56.302368 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6d038b50-e03e-491b-9a74-b92f86b5c04a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:56.309264 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d038b50-e03e-491b-9a74-b92f86b5c04a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:56.309705 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d038b50-e03e-491b-9a74-b92f86b5c04a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:56.310476 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d038b50-e03e-491b-9a74-b92f86b5c04a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:56.310929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d038b50-e03e-491b-9a74-b92f86b5c04a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:56.390294 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6d038b50-e03e-491b-9a74-b92f86b5c04a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "POST /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/action" status: 202 len: 0 microversion: 2.20 time: 0.092719 Jul 11 21:06:56.390994 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 443/881] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jul 11 21:06:56 2022] POST /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:06:56.399677 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:56.400331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:56.408175 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:56.408656 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:56.409421 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:56.409888 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:56.546200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:56.554893 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:56.556415 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:56.557606 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-26146e3a-0587-447a-9ee8-2ff7587b2812 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1671 microversion: 2.20 time: 0.162376 Jul 11 21:06:56.558158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 439/882] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:56 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:57.576401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:57.577023 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:57.583139 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:57.583573 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:57.584362 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:57.584791 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:57.715309 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:57.729577 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:57.731448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:57.732667 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-110b3bd9-d3a9-45be-913f-5b335236e79f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.160312 Jul 11 21:06:57.733236 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 444/883] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:57 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:58.753978 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:58.754589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:58.761772 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:58.762204 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:58.762991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:58.763422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:58.921790 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:58.930544 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:58.932028 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:06:58.933279 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-39b86d3b-44c3-4b07-a8a5-f1f4462eaf00 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.184347 Jul 11 21:06:58.933811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 440/884] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:58 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:06:59.951472 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:06:59.952393 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:06:59.960273 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:59.960837 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:06:59.961880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:06:59.962334 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:00.116018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:00.124869 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:00.126386 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:00.127636 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e32086c8-37ff-4ce4-ac2a-e80f9b178654 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.180393 Jul 11 21:07:00.128340 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 445/885] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:06:59 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:01.146451 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:01.147158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:01.153840 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:01.154290 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:01.155186 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:01.155636 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:01.302795 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:01.312099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:01.313607 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:01.314858 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-3b1333c7-6a63-4bed-b2c0-4ba5a883e997 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.172455 Jul 11 21:07:01.315450 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 441/886] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:01 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:02.332931 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:02.333826 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:02.341477 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:02.341926 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:02.342707 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:02.343174 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:02.484451 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:02.493337 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:02.494984 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:02.496176 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6a9aa278-aa66-4b56-ad2b-f78fdacbb6e9 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.167432 Jul 11 21:07:02.497610 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 446/887] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:02 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:03.516155 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:03.516847 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:03.524076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:03.524510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:03.525408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:03.525839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:03.667910 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:03.676282 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:03.677793 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:03.678987 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7eeba951-6775-4d4e-ada3-05f4eed441a8 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.167495 Jul 11 21:07:03.679586 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 442/888] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:03 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:04.699196 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:04.700193 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:04.706639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:04.707118 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:04.708489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:04.708932 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:04.855579 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:04.874858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:04.880036 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:04.881478 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-000ff5de-ec2e-444b-8481-464bb8f6e55e tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.187217 Jul 11 21:07:04.882269 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 447/889] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:04 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:05.903940 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:05.904686 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:05.911203 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:05.911652 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:05.912442 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:05.913203 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:06.056556 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:06.065027 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:06.066529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:06.067701 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a2c6a8a9-971e-45cc-9e3e-d958175a3f80 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.168550 Jul 11 21:07:06.068289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 443/890] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:05 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:07.087782 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:07.088551 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:07.095340 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:07.095808 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:07.096658 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:07.097106 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:07.236398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:07.244856 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:07.246343 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:07.247496 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7180da7f-7c22-44c7-8647-9d5dfed744fa tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.164101 Jul 11 21:07:07.248066 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 448/891] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:07 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:08.275186 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:08.276168 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:08.287214 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:08.287947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:08.289333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:08.290051 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:08.435358 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:08.443688 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:08.445213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:08.446367 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-12f990b0-647e-4fe8-a610-a7037330a429 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.178069 Jul 11 21:07:08.446942 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 444/892] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:08 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:09.468603 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:09.469364 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:09.477448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:09.478004 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:09.478934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:09.479469 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:09.621892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:09.630426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:09.631892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:09.633065 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0183d9bc-4544-444d-886f-a7c6ed81732a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.170487 Jul 11 21:07:09.633607 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 449/893] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:09 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:10.661533 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:10.662537 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:10.671758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:10.672610 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:10.673376 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:10.673808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:10.809558 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:10.817929 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:10.819432 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:10.820634 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2cb2e9bb-b729-435a-9bab-bb4009bf96fb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.165786 Jul 11 21:07:10.821200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 445/894] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:10 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:11.842031 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:11.842630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:11.849037 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:11.849511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:11.850237 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:11.850663 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:11.994791 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:11.998059 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:12.009112 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:12.011651 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:12.013115 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b45d068c-d254-4357-9738-c23ed99855b5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.176305 Jul 11 21:07:12.013682 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 450/895] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:11 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:13.041298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:13.042318 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:13.050954 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:13.051392 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:13.052163 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:13.052628 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:13.208834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:13.219299 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:13.220847 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:13.222036 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8d8a2960-3be8-4f14-be69-a624826ea450 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.187409 Jul 11 21:07:13.222601 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 446/896] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:13 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:14.250845 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:14.251797 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:14.263215 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:14.263664 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:14.264464 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:14.264895 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:14.405628 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:14.416252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:14.417818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:14.418958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-71b8ccb1-7d84-4e56-b1fd-2ea57eead54d tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.176438 Jul 11 21:07:14.419515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 451/897] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:14 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:15.439479 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:15.440315 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:15.447145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:15.447593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:15.448401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:15.448834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:15.586337 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:15.594814 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:15.596356 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:15.597537 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7e64db25-b392-4617-8922-118151ff1673 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.162492 Jul 11 21:07:15.598116 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 447/898] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:15 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:16.619597 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:16.620919 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:16.630816 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:16.631583 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:16.632933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:16.633616 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:16.771549 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:16.784804 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:16.787172 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:16.788998 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-35fc84a9-f611-4bbd-958f-8aa29f7abe51 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.175566 Jul 11 21:07:16.789560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 452/899] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:16 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:17.809151 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:17.809862 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:17.816550 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:17.816994 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:17.817762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:17.818194 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:17.822500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:17.957305 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:17.968267 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:17.969864 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:17.971029 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e36dd962-d905-4861-be2f-9de239fd17bb tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.165892 Jul 11 21:07:17.971586 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 448/900] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:17 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:18.995572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:18.996470 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:18.999419 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=34 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:19.008600 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:19.009339 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:19.010622 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:19.011313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:19.156371 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:19.164710 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:19.166204 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:19.167360 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5d00e9c0-d3e5-472b-ab2e-bf63091e43c0 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.177965 Jul 11 21:07:19.167961 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 453/901] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:18 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:19.761947 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-aea2cb3e-8428-43a3-9826-3c6cd42b4f14 req-156ea653-1c12-4d24-b928-eb9ee3f3708d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169a98b1-4200-4917-86bd-62e3581530f0", "name": "network-vif-plugged", "status": "completed", "tag": "744bb15f-623b-4153-b111-d80b7f202ffc"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:19.767079 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=30 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:19.772944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-aea2cb3e-8428-43a3-9826-3c6cd42b4f14 req-156ea653-1c12-4d24-b928-eb9ee3f3708d service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:19.773486 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-aea2cb3e-8428-43a3-9826-3c6cd42b4f14 req-156ea653-1c12-4d24-b928-eb9ee3f3708d service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:19.786717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-aea2cb3e-8428-43a3-9826-3c6cd42b4f14 req-156ea653-1c12-4d24-b928-eb9ee3f3708d service nova] Creating event network-vif-plugged:744bb15f-623b-4153-b111-d80b7f202ffc for instance 169a98b1-4200-4917-86bd-62e3581530f0 on hv-cinder-84902 Jul 11 21:07:19.792529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-aea2cb3e-8428-43a3-9826-3c6cd42b4f14 req-156ea653-1c12-4d24-b928-eb9ee3f3708d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034317 Jul 11 21:07:19.793711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 449/902] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:20.186701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:20.187800 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:20.193815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:20.194263 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:20.195091 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:20.195532 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:20.393089 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:20.401701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:20.403187 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:20.404364 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c3e51455-1ad2-4e79-bb82-a6fae54f505b tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.221737 Jul 11 21:07:20.404965 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 454/903] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:20 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:21.428595 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:21.429730 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:21.439659 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:21.440126 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:21.440899 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:21.441331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:21.682301 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:21.690685 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:21.692212 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:21.693381 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-423d608b-3111-4597-a876-770c3821bc34 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.272415 Jul 11 21:07:21.693958 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 450/904] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:21 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:22.245659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5176083a-535b-41c2-9d7f-d5d93a9b2cba tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1300502349"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:22.246261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5176083a-535b-41c2-9d7f-d5d93a9b2cba tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:22.253107 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5176083a-535b-41c2-9d7f-d5d93a9b2cba tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:22.253556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5176083a-535b-41c2-9d7f-d5d93a9b2cba tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:22.254338 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5176083a-535b-41c2-9d7f-d5d93a9b2cba tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:22.254764 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5176083a-535b-41c2-9d7f-d5d93a9b2cba tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:22.386071 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.network.security_group_api [None req-5176083a-535b-41c2-9d7f-d5d93a9b2cba tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Removing security group d6726e58-642c-4be1-aaef-ec5a328910d5 from port f2193191-95da-4dac-8666-32647c0fe803 Jul 11 21:07:22.712441 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:22.713056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:22.720229 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:22.720681 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:22.721457 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:22.721891 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:22.779936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5176083a-535b-41c2-9d7f-d5d93a9b2cba tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "POST /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/action" status: 202 len: 0 microversion: 2.1 time: 0.540597 Jul 11 21:07:22.789822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 455/905] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:07:22 2022] POST /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:07:22.798489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-058fa680-5ff8-46aa-b2ca-f47023ab9887 req-89a50e6c-0f34-4f95-822c-23ce6b6e58af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1013294-9d36-4435-8113-260bfdee6c2e", "tag": "f2193191-95da-4dac-8666-32647c0fe803"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:22.809284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-058fa680-5ff8-46aa-b2ca-f47023ab9887 req-89a50e6c-0f34-4f95-822c-23ce6b6e58af service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:22.810071 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-058fa680-5ff8-46aa-b2ca-f47023ab9887 req-89a50e6c-0f34-4f95-822c-23ce6b6e58af service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:22.836921 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-058fa680-5ff8-46aa-b2ca-f47023ab9887 req-89a50e6c-0f34-4f95-822c-23ce6b6e58af service nova] Creating event network-changed:f2193191-95da-4dac-8666-32647c0fe803 for instance a1013294-9d36-4435-8113-260bfdee6c2e on hv-cinder-84902 Jul 11 21:07:22.858721 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-058fa680-5ff8-46aa-b2ca-f47023ab9887 req-89a50e6c-0f34-4f95-822c-23ce6b6e58af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070329 Jul 11 21:07:22.862754 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 456/906] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:22.938991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:22.947923 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:22.951072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:22.952808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7969f712-99af-4bdc-8218-75a606a0e51c tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1729 microversion: 2.20 time: 0.244296 Jul 11 21:07:22.953776 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 451/907] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:22 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:23.972253 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:23.972956 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:23.979233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:23.979692 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:23.980679 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:23.981154 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:24.124818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:24.133758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:24.135261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:24.136603 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ac6a56c2-260e-41b5-944a-2ee7625b1342 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1716 microversion: 2.20 time: 0.169274 Jul 11 21:07:24.137176 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 457/908] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:07:23 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:07:24.518559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-882796985", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-538925586", "security_groups": [{"name": "tempest-secgroup-smoke-1512411600"}], "block_device_mapping_v2": [{"uuid": "a39df0fa-8f42-403c-8f8f-a6bcab15913e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa18e945-a5c1-46c3-85a2-9a904972193b"}]}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:24.673410 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5c7bb73f-e3df-41a6-90d6-c805e1af659d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:24.675460 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] validate_networks() for [('fa18e945-a5c1-46c3-85a2-9a904972193b', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:07:24.676862 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5c7bb73f-e3df-41a6-90d6-c805e1af659d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:24.685666 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c7bb73f-e3df-41a6-90d6-c805e1af659d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:24.686225 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c7bb73f-e3df-41a6-90d6-c805e1af659d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:24.687256 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c7bb73f-e3df-41a6-90d6-c805e1af659d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:24.687932 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5c7bb73f-e3df-41a6-90d6-c805e1af659d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:24.774729 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-5c7bb73f-e3df-41a6-90d6-c805e1af659d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lazy-loading 'services' on Instance uuid a1013294-9d36-4435-8113-260bfdee6c2e {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:07:24.866700 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5c7bb73f-e3df-41a6-90d6-c805e1af659d tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments/ca1ee919-abd2-4221-b952-af981b0adec2" status: 202 len: 0 microversion: 2.1 time: 0.198056 Jul 11 21:07:24.867462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 458/909] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:07:24 2022] DELETE /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments/ca1ee919-abd2-4221-b952-af981b0adec2 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 21:07:24.876183 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-9f6dfc67-bf72-4402-b6a4-3d3a3493334c req-e0223826-0d8a-483e-8d66-d42b4079b0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1013294-9d36-4435-8113-260bfdee6c2e", "tag": "f2193191-95da-4dac-8666-32647c0fe803"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:24.886203 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9f6dfc67-bf72-4402-b6a4-3d3a3493334c req-e0223826-0d8a-483e-8d66-d42b4079b0d7 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:24.886843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-9f6dfc67-bf72-4402-b6a4-3d3a3493334c req-e0223826-0d8a-483e-8d66-d42b4079b0d7 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:24.904100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-9f6dfc67-bf72-4402-b6a4-3d3a3493334c req-e0223826-0d8a-483e-8d66-d42b4079b0d7 service nova] Creating event network-changed:f2193191-95da-4dac-8666-32647c0fe803 for instance a1013294-9d36-4435-8113-260bfdee6c2e on hv-cinder-84902 Jul 11 21:07:24.910980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-9f6dfc67-bf72-4402-b6a4-3d3a3493334c req-e0223826-0d8a-483e-8d66-d42b4079b0d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041803 Jul 11 21:07:24.912473 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 459/910] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:24.917880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2202851c-331c-4c87-a426-3c742d0accbc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:24.919113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2202851c-331c-4c87-a426-3c742d0accbc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:24.928298 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2202851c-331c-4c87-a426-3c742d0accbc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:24.929036 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2202851c-331c-4c87-a426-3c742d0accbc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:24.930010 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2202851c-331c-4c87-a426-3c742d0accbc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:24.930431 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2202851c-331c-4c87-a426-3c742d0accbc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:24.964478 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2202851c-331c-4c87-a426-3c742d0accbc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050391 Jul 11 21:07:24.965479 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 460/911] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:07:24 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:25.146994 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:07:25.147429 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:07:25.147898 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:07:25.148327 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:07:25.148736 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:07:25.158274 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:25.158735 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:25.159560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:25.160015 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:25.178006 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Getting quotas for project 6ed25b82be2043b188d2682a5c01490a. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:07:25.182114 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Getting quotas for user 5f8c2e5e6c1b4833b0e9af0de8814d13 and project 6ed25b82be2043b188d2682a5c01490a. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:07:25.242253 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:07:25.244506 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a39df0fa-8f42-403c-8f8f-a6bcab15913e',volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:07:25.377652 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR oslo.messaging._drivers.impl_rabbit [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [39ca6b20-820e-4b6f-b242-0b82d5c21a41] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 21:07:25.978099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-302c05ec-a5a4-4493-aa3c-f75bf5c43308 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:25.979008 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-302c05ec-a5a4-4493-aa3c-f75bf5c43308 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:25.985284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-302c05ec-a5a4-4493-aa3c-f75bf5c43308 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:25.985721 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-302c05ec-a5a4-4493-aa3c-f75bf5c43308 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:25.986543 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-302c05ec-a5a4-4493-aa3c-f75bf5c43308 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:25.986964 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-302c05ec-a5a4-4493-aa3c-f75bf5c43308 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:26.018557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-302c05ec-a5a4-4493-aa3c-f75bf5c43308 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044637 Jul 11 21:07:26.019130 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 461/912] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:07:25 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 11 21:07:26.028526 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:26.029005 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:26.034836 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:26.035248 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:26.035992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:26.036448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:26.118721 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] HTTP exception thrown: Instance a1013294-9d36-4435-8113-260bfdee6c2e is not attached to volume ca1ee919-abd2-4221-b952-af981b0adec2 Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Request method failure captured: Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: DELETE /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments/ca1ee919-abd2-4221-b952-af981b0adec2 HTTP/1.1 Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJAS4Ux29Q7zBesdqptp-3gmz9UBIZqmdtNNT9OXAG0bZoX42RLYuPrA3eE008gZP2UumYzRHb-yg4oeu86kE77io-jbRveUs8HinseeXthM7q-e2QsdMHuWioOMkZGM2dgH2J9vCDZvTViCM0_JzTSgr3qm1kOJZrTHvlT1a6NV6Ww Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 6f54283593cd4e71ba6b700377bf0b4e Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-TestMinimumBasicScenario-833527338 Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:07:26.130099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f54283593cd4e71ba6b700377bf0b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f54283593cd4e71ba6b700377bf0b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f54283593cd4e71ba6b700377bf0b4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f54283593cd4e71ba6b700377bf0b4e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-TestMinimumBasicScenario-833527338 Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 6f54283593cd4e71ba6b700377bf0b4e Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-TestMinimumBasicScenario-833527338 Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-TestMinimumBasicScenario-833527338-project Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: de2fb55182604091b35826b2c2fd090c Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-TestMinimumBasicScenario-833527338-project Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:07:26.131653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance a1013294-9d36-4435-8113-260bfdee6c2e is not attached to volume ca1ee919-abd2-4221-b952-af981b0adec2 Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'server_id': 'a1013294-9d36-4435-8113-260bfdee6c2e', 'id': 'ca1ee919-abd2-4221-b952-af981b0adec2'} Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ca1ee919-abd2-4221-b952-af981b0adec2. Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:07:26.135903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1013294-9d36-4435-8113-260bfdee6c2e is not attached to volume ca1ee919-abd2-4221-b952-af981b0adec2 Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1013294-9d36-4435-8113-260bfdee6c2e is not attached to volume ca1ee919-abd2-4221-b952-af981b0adec2 Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:26.137370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Returning 404 to user: Instance a1013294-9d36-4435-8113-260bfdee6c2e is not attached to volume ca1ee919-abd2-4221-b952-af981b0adec2 {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:07:26.138572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d8b38d15-13ed-4ac6-aede-f8daf63aaddc tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments/ca1ee919-abd2-4221-b952-af981b0adec2" status: 404 len: 154 microversion: 2.1 time: 0.106670 Jul 11 21:07:26.138572 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 462/913] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:07:26 2022] DELETE /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e/os-volume_attachments/ca1ee919-abd2-4221-b952-af981b0adec2 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:07:26.389534 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO oslo.messaging._drivers.impl_rabbit [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [39ca6b20-820e-4b6f-b242-0b82d5c21a41] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44418. Jul 11 21:07:26.394374 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-89608ead-120b-464c-8bf1-89783193c886 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.879785 Jul 11 21:07:26.395050 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 452/914] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:07:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:07:26.405239 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a3e8ad56-d499-4377-918a-b57ba11dc842 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:26.405858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a3e8ad56-d499-4377-918a-b57ba11dc842 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:26.460851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a3e8ad56-d499-4377-918a-b57ba11dc842 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:26.468570 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a3e8ad56-d499-4377-918a-b57ba11dc842 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1093 microversion: 2.1 time: 0.067256 Jul 11 21:07:26.469132 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 463/915] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:26 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:27.275176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9d1efcef-ffe0-4c5b-9d6e-a2c6a72f6ae8 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:27.275677 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9d1efcef-ffe0-4c5b-9d6e-a2c6a72f6ae8 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:27.282443 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9d1efcef-ffe0-4c5b-9d6e-a2c6a72f6ae8 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:27.282926 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9d1efcef-ffe0-4c5b-9d6e-a2c6a72f6ae8 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:27.283683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9d1efcef-ffe0-4c5b-9d6e-a2c6a72f6ae8 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:27.284152 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9d1efcef-ffe0-4c5b-9d6e-a2c6a72f6ae8 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:27.309306 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9d1efcef-ffe0-4c5b-9d6e-a2c6a72f6ae8 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:07:27.388940 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9d1efcef-ffe0-4c5b-9d6e-a2c6a72f6ae8 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 204 len: 0 microversion: 2.1 time: 0.117915 Jul 11 21:07:27.389515 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 453/916] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:07:27 2022] DELETE /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:07:27.397813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b36c207e-e886-4803-8c82-5a1d16cb4502 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:27.398428 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b36c207e-e886-4803-8c82-5a1d16cb4502 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:27.405082 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b36c207e-e886-4803-8c82-5a1d16cb4502 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:27.405529 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b36c207e-e886-4803-8c82-5a1d16cb4502 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:27.406296 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b36c207e-e886-4803-8c82-5a1d16cb4502 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:27.406826 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b36c207e-e886-4803-8c82-5a1d16cb4502 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:27.486126 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-94a2bc6e-313f-4026-8655-55b273ac9d10 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:27.486831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-94a2bc6e-313f-4026-8655-55b273ac9d10 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:27.493107 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94a2bc6e-313f-4026-8655-55b273ac9d10 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:27.493561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94a2bc6e-313f-4026-8655-55b273ac9d10 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:27.494329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94a2bc6e-313f-4026-8655-55b273ac9d10 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:27.494760 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-94a2bc6e-313f-4026-8655-55b273ac9d10 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:27.534408 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b36c207e-e886-4803-8c82-5a1d16cb4502 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:27.542724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b36c207e-e886-4803-8c82-5a1d16cb4502 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1554 microversion: 2.1 time: 0.148742 Jul 11 21:07:27.543549 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 464/917] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:27 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:07:27.566769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-94a2bc6e-313f-4026-8655-55b273ac9d10 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:27.574405 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-94a2bc6e-313f-4026-8655-55b273ac9d10 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1199 microversion: 2.1 time: 0.092650 Jul 11 21:07:27.574963 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 454/918] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:27 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:28.564743 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2a283eb8-8991-4e27-853c-8c0b343a06ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:28.565714 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2a283eb8-8991-4e27-853c-8c0b343a06ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:28.576076 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a283eb8-8991-4e27-853c-8c0b343a06ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:28.576881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a283eb8-8991-4e27-853c-8c0b343a06ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:28.578115 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a283eb8-8991-4e27-853c-8c0b343a06ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:28.578812 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a283eb8-8991-4e27-853c-8c0b343a06ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:28.591472 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d87d71a3-2710-4ab1-95b7-fdc64fef6de8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:28.592169 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d87d71a3-2710-4ab1-95b7-fdc64fef6de8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:28.599124 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d87d71a3-2710-4ab1-95b7-fdc64fef6de8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:28.599597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d87d71a3-2710-4ab1-95b7-fdc64fef6de8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:28.600453 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d87d71a3-2710-4ab1-95b7-fdc64fef6de8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:28.600887 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d87d71a3-2710-4ab1-95b7-fdc64fef6de8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:28.662802 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d87d71a3-2710-4ab1-95b7-fdc64fef6de8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:28.670434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d87d71a3-2710-4ab1-95b7-fdc64fef6de8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1199 microversion: 2.1 time: 0.082795 Jul 11 21:07:28.670956 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 455/919] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:28 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:28.720843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2a283eb8-8991-4e27-853c-8c0b343a06ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:28.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2a283eb8-8991-4e27-853c-8c0b343a06ce tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1554 microversion: 2.1 time: 0.170586 Jul 11 21:07:28.729242 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 465/920] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:28 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:29.687426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c72f82b5-ae71-42df-8f9c-e87d919eabbe tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:29.688080 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c72f82b5-ae71-42df-8f9c-e87d919eabbe tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:29.694510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c72f82b5-ae71-42df-8f9c-e87d919eabbe tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:29.694949 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c72f82b5-ae71-42df-8f9c-e87d919eabbe tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:29.695717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c72f82b5-ae71-42df-8f9c-e87d919eabbe tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:29.696172 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c72f82b5-ae71-42df-8f9c-e87d919eabbe tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:29.746257 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-06445759-5acf-4151-bc71-e30eb56fb388 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:29.746949 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-06445759-5acf-4151-bc71-e30eb56fb388 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:29.753448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-06445759-5acf-4151-bc71-e30eb56fb388 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:29.753855 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-06445759-5acf-4151-bc71-e30eb56fb388 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:29.754617 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-06445759-5acf-4151-bc71-e30eb56fb388 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:29.755228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-06445759-5acf-4151-bc71-e30eb56fb388 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:29.763743 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c72f82b5-ae71-42df-8f9c-e87d919eabbe tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:29.772547 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c72f82b5-ae71-42df-8f9c-e87d919eabbe tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1209 microversion: 2.1 time: 0.089033 Jul 11 21:07:29.782196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 456/921] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:29 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:29.902351 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-06445759-5acf-4151-bc71-e30eb56fb388 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:29.914877 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-06445759-5acf-4151-bc71-e30eb56fb388 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1554 microversion: 2.1 time: 0.170952 Jul 11 21:07:29.915560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 466/922] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:29 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:07:30.790401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-566cbec7-bbb0-49bb-a0dd-832ad177bbd4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:30.791663 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-566cbec7-bbb0-49bb-a0dd-832ad177bbd4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:30.798821 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-566cbec7-bbb0-49bb-a0dd-832ad177bbd4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:30.799271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-566cbec7-bbb0-49bb-a0dd-832ad177bbd4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:30.800027 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-566cbec7-bbb0-49bb-a0dd-832ad177bbd4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:30.800773 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-566cbec7-bbb0-49bb-a0dd-832ad177bbd4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:30.881331 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-b03b889f-1051-4eb9-bd69-64ad88ab7025 req-1ebeabe3-cf89-4e87-847c-5555699d8a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1013294-9d36-4435-8113-260bfdee6c2e", "name": "network-vif-deleted", "tag": "f2193191-95da-4dac-8666-32647c0fe803"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:30.891333 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b03b889f-1051-4eb9-bd69-64ad88ab7025 req-1ebeabe3-cf89-4e87-847c-5555699d8a8b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:30.891775 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-b03b889f-1051-4eb9-bd69-64ad88ab7025 req-1ebeabe3-cf89-4e87-847c-5555699d8a8b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:30.904944 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-b03b889f-1051-4eb9-bd69-64ad88ab7025 req-1ebeabe3-cf89-4e87-847c-5555699d8a8b service nova] Creating event network-vif-deleted:f2193191-95da-4dac-8666-32647c0fe803 for instance a1013294-9d36-4435-8113-260bfdee6c2e on hv-cinder-84902 Jul 11 21:07:30.912775 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-b03b889f-1051-4eb9-bd69-64ad88ab7025 req-1ebeabe3-cf89-4e87-847c-5555699d8a8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037475 Jul 11 21:07:30.913731 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 467/923] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:07:30.932964 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-784de38e-186c-4d1d-ace4-6e1a21263e08 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:30.933744 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-784de38e-186c-4d1d-ace4-6e1a21263e08 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:30.940166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-784de38e-186c-4d1d-ace4-6e1a21263e08 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:30.940612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-784de38e-186c-4d1d-ace4-6e1a21263e08 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:30.941494 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-784de38e-186c-4d1d-ace4-6e1a21263e08 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:30.941922 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-784de38e-186c-4d1d-ace4-6e1a21263e08 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:31.007201 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-784de38e-186c-4d1d-ace4-6e1a21263e08 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2fb55182604091b35826b2c2fd090c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f54283593cd4e71ba6b700377bf0b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:31.017396 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-566cbec7-bbb0-49bb-a0dd-832ad177bbd4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:31.026771 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-566cbec7-bbb0-49bb-a0dd-832ad177bbd4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.240360 Jul 11 21:07:31.027372 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 457/924] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:30 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:31.029415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-784de38e-186c-4d1d-ace4-6e1a21263e08 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 200 len: 1343 microversion: 2.1 time: 0.100543 Jul 11 21:07:31.029992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 468/925] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:30 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 1343 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:07:32.046004 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6acf6ab5-1972-44b8-92f1-0800ef67087c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:32.046478 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:32.047289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6acf6ab5-1972-44b8-92f1-0800ef67087c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:32.047483 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] [instance: a1013294-9d36-4435-8113-260bfdee6c2e] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:32.053719 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:32.054007 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6acf6ab5-1972-44b8-92f1-0800ef67087c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:32.054167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:32.054700 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6acf6ab5-1972-44b8-92f1-0800ef67087c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:32.055129 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:32.055557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:32.055664 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6acf6ab5-1972-44b8-92f1-0800ef67087c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:32.056159 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6acf6ab5-1972-44b8-92f1-0800ef67087c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:32.070335 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] HTTP exception thrown: Instance a1013294-9d36-4435-8113-260bfdee6c2e could not be found. Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Request method failure captured: Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e HTTP/1.1 Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJAS4Ux29Q7zBesdqptp-3gmz9UBIZqmdtNNT9OXAG0bZoX42RLYuPrA3eE008gZP2UumYzRHb-yg4oeu86kE77io-jbRveUs8HinseeXthM7q-e2QsdMHuWioOMkZGM2dgH2J9vCDZvTViCM0_JzTSgr3qm1kOJZrTHvlT1a6NV6Ww Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 6f54283593cd4e71ba6b700377bf0b4e Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-TestMinimumBasicScenario-833527338 Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:07:32.072090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f54283593cd4e71ba6b700377bf0b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f54283593cd4e71ba6b700377bf0b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f54283593cd4e71ba6b700377bf0b4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f54283593cd4e71ba6b700377bf0b4e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-TestMinimumBasicScenario-833527338 Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 6f54283593cd4e71ba6b700377bf0b4e Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-TestMinimumBasicScenario-833527338 Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-TestMinimumBasicScenario-833527338-project Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: de2fb55182604091b35826b2c2fd090c Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-TestMinimumBasicScenario-833527338-project Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance a1013294-9d36-4435-8113-260bfdee6c2e could not be found. Jul 11 21:07:32.073717 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'a1013294-9d36-4435-8113-260bfdee6c2e'} Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1013294-9d36-4435-8113-260bfdee6c2e could not be found. Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:07:32.074652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1013294-9d36-4435-8113-260bfdee6c2e could not be found. Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1013294-9d36-4435-8113-260bfdee6c2e could not be found. Jul 11 21:07:32.076971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:07:32.078221 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Returning 404 to user: Instance a1013294-9d36-4435-8113-260bfdee6c2e could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:07:32.078221 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-cfd14e43-191d-4574-9228-f99b795820b7 tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e" status: 404 len: 111 microversion: 2.1 time: 0.031791 Jul 11 21:07:32.078221 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 469/926] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:32 2022] GET /compute/v2.1/servers/a1013294-9d36-4435-8113-260bfdee6c2e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:07:32.084967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-42e82073-5492-4938-8871-81e921081e4e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] Calling method '.version_select at 0x7f38401cdd30>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:32.107725 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-42e82073-5492-4938-8871-81e921081e4e tempest-TestMinimumBasicScenario-833527338 tempest-TestMinimumBasicScenario-833527338-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-266614097" status: 202 len: 0 microversion: 2.1 time: 0.027539 Jul 11 21:07:32.108343 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 470/927] 10.222.0.20 () {58 vars in 1268 bytes} [Mon Jul 11 21:07:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-266614097 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 21:07:32.236268 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6acf6ab5-1972-44b8-92f1-0800ef67087c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:32.244347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6acf6ab5-1972-44b8-92f1-0800ef67087c tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.202706 Jul 11 21:07:32.245089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 458/928] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:32 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:32.936805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-705700ad-4035-4a89-95f1-a8ea1b09f2ff req-b3120081-53f9-4620-a2a8-2d56dd351654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2606d8-c53b-4b15-a39d-5bb8f364ceb0", "tag": "1b700fff-4710-4b5d-b1f9-7e44e3268d34"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:32.946511 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-705700ad-4035-4a89-95f1-a8ea1b09f2ff req-b3120081-53f9-4620-a2a8-2d56dd351654 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:32.946947 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-705700ad-4035-4a89-95f1-a8ea1b09f2ff req-b3120081-53f9-4620-a2a8-2d56dd351654 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:32.957860 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-705700ad-4035-4a89-95f1-a8ea1b09f2ff req-b3120081-53f9-4620-a2a8-2d56dd351654 service nova] Creating event network-changed:1b700fff-4710-4b5d-b1f9-7e44e3268d34 for instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 on hv-cinder-84902 Jul 11 21:07:32.962786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-705700ad-4035-4a89-95f1-a8ea1b09f2ff req-b3120081-53f9-4620-a2a8-2d56dd351654 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030259 Jul 11 21:07:32.963373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 471/929] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:33.261665 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0fdb8866-e46c-487d-8c4a-37ac637142f7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:33.262274 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0fdb8866-e46c-487d-8c4a-37ac637142f7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:33.268611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0fdb8866-e46c-487d-8c4a-37ac637142f7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:33.269061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0fdb8866-e46c-487d-8c4a-37ac637142f7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:33.269865 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0fdb8866-e46c-487d-8c4a-37ac637142f7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:33.270869 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0fdb8866-e46c-487d-8c4a-37ac637142f7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:33.647231 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0fdb8866-e46c-487d-8c4a-37ac637142f7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:33.655207 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0fdb8866-e46c-487d-8c4a-37ac637142f7 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.397492 Jul 11 21:07:33.655755 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 459/930] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:33 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:34.672857 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d64b42ac-871c-47b0-9d3a-5056a65a19d8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:34.673653 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d64b42ac-871c-47b0-9d3a-5056a65a19d8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:34.684135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d64b42ac-871c-47b0-9d3a-5056a65a19d8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:34.684729 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d64b42ac-871c-47b0-9d3a-5056a65a19d8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:34.685514 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d64b42ac-871c-47b0-9d3a-5056a65a19d8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:34.685950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d64b42ac-871c-47b0-9d3a-5056a65a19d8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:34.702354 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:34.825747 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d64b42ac-871c-47b0-9d3a-5056a65a19d8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:34.833859 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d64b42ac-871c-47b0-9d3a-5056a65a19d8 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.165796 Jul 11 21:07:34.834452 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 472/931] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:34 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:35.850390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-721af9e7-882a-4cce-af4e-67e7c5f240fb tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:35.850996 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-721af9e7-882a-4cce-af4e-67e7c5f240fb tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:35.853506 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:35.854174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:35.860574 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-721af9e7-882a-4cce-af4e-67e7c5f240fb tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:35.861024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-721af9e7-882a-4cce-af4e-67e7c5f240fb tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:35.861786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-721af9e7-882a-4cce-af4e-67e7c5f240fb tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:35.862215 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-721af9e7-882a-4cce-af4e-67e7c5f240fb tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:36.000679 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-721af9e7-882a-4cce-af4e-67e7c5f240fb tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:36.009439 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-721af9e7-882a-4cce-af4e-67e7c5f240fb tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.162948 Jul 11 21:07:36.010031 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 460/932] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:35 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:37.032922 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d640f6ee-f824-4bb6-8060-14af97dd1903 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:37.033921 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d640f6ee-f824-4bb6-8060-14af97dd1903 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:37.036647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:37.042336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d640f6ee-f824-4bb6-8060-14af97dd1903 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:37.042775 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d640f6ee-f824-4bb6-8060-14af97dd1903 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:37.043542 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d640f6ee-f824-4bb6-8060-14af97dd1903 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:37.043978 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d640f6ee-f824-4bb6-8060-14af97dd1903 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:37.275599 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d640f6ee-f824-4bb6-8060-14af97dd1903 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:37.284195 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d640f6ee-f824-4bb6-8060-14af97dd1903 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.257682 Jul 11 21:07:37.284773 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 473/933] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:37 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:38.302766 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-38bfa7d9-73db-4f00-94e7-477555c79a5e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:38.303225 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-38bfa7d9-73db-4f00-94e7-477555c79a5e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:38.312649 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-38bfa7d9-73db-4f00-94e7-477555c79a5e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:38.313294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-38bfa7d9-73db-4f00-94e7-477555c79a5e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:38.314149 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-38bfa7d9-73db-4f00-94e7-477555c79a5e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:38.314470 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-38bfa7d9-73db-4f00-94e7-477555c79a5e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:38.504099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-38bfa7d9-73db-4f00-94e7-477555c79a5e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:38.512142 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-38bfa7d9-73db-4f00-94e7-477555c79a5e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.214975 Jul 11 21:07:38.512733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 461/934] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:38 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:39.530111 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-f7178565-312b-448f-a662-22a7b20710f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:39.530758 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-f7178565-312b-448f-a662-22a7b20710f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:39.537349 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f7178565-312b-448f-a662-22a7b20710f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:39.537798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f7178565-312b-448f-a662-22a7b20710f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:39.538581 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f7178565-312b-448f-a662-22a7b20710f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:39.539017 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-f7178565-312b-448f-a662-22a7b20710f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:39.674936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-f7178565-312b-448f-a662-22a7b20710f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:39.682815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-f7178565-312b-448f-a662-22a7b20710f0 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.156985 Jul 11 21:07:39.683461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 474/935] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:39 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:40.700306 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5ca68c8c-b4c0-4059-a2ad-eb96de0236f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:40.701214 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5ca68c8c-b4c0-4059-a2ad-eb96de0236f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:40.707870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5ca68c8c-b4c0-4059-a2ad-eb96de0236f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:40.708362 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5ca68c8c-b4c0-4059-a2ad-eb96de0236f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:40.709131 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5ca68c8c-b4c0-4059-a2ad-eb96de0236f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:40.709567 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5ca68c8c-b4c0-4059-a2ad-eb96de0236f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:40.851500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5ca68c8c-b4c0-4059-a2ad-eb96de0236f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:40.859425 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5ca68c8c-b4c0-4059-a2ad-eb96de0236f6 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.163108 Jul 11 21:07:40.860020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 462/936] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:40 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:41.001686 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-66a53ff6-467d-4ee3-82e8-05e359aff175 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:41.002172 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-66a53ff6-467d-4ee3-82e8-05e359aff175 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:41.009078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66a53ff6-467d-4ee3-82e8-05e359aff175 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:41.009546 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66a53ff6-467d-4ee3-82e8-05e359aff175 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:41.010312 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66a53ff6-467d-4ee3-82e8-05e359aff175 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:41.010741 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66a53ff6-467d-4ee3-82e8-05e359aff175 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:41.034392 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-66a53ff6-467d-4ee3-82e8-05e359aff175 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/ips" status: 200 len: 145 microversion: 2.1 time: 0.036559 Jul 11 21:07:41.035280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 475/937] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 21:07:40 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:41.878164 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8b0433a2-893d-4078-afa7-d3b7573fd5b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:41.880330 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8b0433a2-893d-4078-afa7-d3b7573fd5b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:41.888299 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b0433a2-893d-4078-afa7-d3b7573fd5b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:41.888991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b0433a2-893d-4078-afa7-d3b7573fd5b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:41.889839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b0433a2-893d-4078-afa7-d3b7573fd5b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:41.890352 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8b0433a2-893d-4078-afa7-d3b7573fd5b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:42.043613 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8b0433a2-893d-4078-afa7-d3b7573fd5b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:42.052639 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8b0433a2-893d-4078-afa7-d3b7573fd5b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.178263 Jul 11 21:07:42.053468 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 463/938] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:41 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:43.070209 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-09110636-ef00-4e85-a581-fe45e55e3221 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:43.071120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-09110636-ef00-4e85-a581-fe45e55e3221 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:43.077513 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09110636-ef00-4e85-a581-fe45e55e3221 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:43.078040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09110636-ef00-4e85-a581-fe45e55e3221 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:43.078871 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09110636-ef00-4e85-a581-fe45e55e3221 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:43.079375 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09110636-ef00-4e85-a581-fe45e55e3221 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:43.319391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-09110636-ef00-4e85-a581-fe45e55e3221 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:43.330714 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-09110636-ef00-4e85-a581-fe45e55e3221 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.264434 Jul 11 21:07:43.339667 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 476/939] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:43 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:43.423526 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-820528ce-63e4-4f24-aa72-ddcc771da1c3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26b32ae2-b786-45ff-a0a2-d286e41c22a1"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:43.425308 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-820528ce-63e4-4f24-aa72-ddcc771da1c3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:43.432137 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-820528ce-63e4-4f24-aa72-ddcc771da1c3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:43.432615 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-820528ce-63e4-4f24-aa72-ddcc771da1c3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:43.433393 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-820528ce-63e4-4f24-aa72-ddcc771da1c3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:43.433825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-820528ce-63e4-4f24-aa72-ddcc771da1c3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:43.451148 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:43.752535 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-820528ce-63e4-4f24-aa72-ddcc771da1c3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333249 Jul 11 21:07:43.753828 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 464/940] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:07:43 2022] POST /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:44.234336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-d8245b52-3176-431b-ac1f-f139719ac952 req-cb9a6fa6-bf1a-433c-af26-c8ebffe8b2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2606d8-c53b-4b15-a39d-5bb8f364ceb0", "name": "network-vif-plugged", "status": "completed", "tag": "1b700fff-4710-4b5d-b1f9-7e44e3268d34"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:44.245249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-d8245b52-3176-431b-ac1f-f139719ac952 req-cb9a6fa6-bf1a-433c-af26-c8ebffe8b2be service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:44.245720 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-d8245b52-3176-431b-ac1f-f139719ac952 req-cb9a6fa6-bf1a-433c-af26-c8ebffe8b2be service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:44.260436 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-d8245b52-3176-431b-ac1f-f139719ac952 req-cb9a6fa6-bf1a-433c-af26-c8ebffe8b2be service nova] Creating event network-vif-plugged:1b700fff-4710-4b5d-b1f9-7e44e3268d34 for instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 on hv-cinder-84902 Jul 11 21:07:44.266327 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-d8245b52-3176-431b-ac1f-f139719ac952 req-cb9a6fa6-bf1a-433c-af26-c8ebffe8b2be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036018 Jul 11 21:07:44.267379 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 477/941] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:07:44.349984 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fb171537-37de-43b2-ba0a-1b93be311601 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:44.350674 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fb171537-37de-43b2-ba0a-1b93be311601 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:44.357447 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fb171537-37de-43b2-ba0a-1b93be311601 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:44.357714 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fb171537-37de-43b2-ba0a-1b93be311601 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:44.358684 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fb171537-37de-43b2-ba0a-1b93be311601 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:44.359124 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fb171537-37de-43b2-ba0a-1b93be311601 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:44.530258 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-fb171537-37de-43b2-ba0a-1b93be311601 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:44.539788 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fb171537-37de-43b2-ba0a-1b93be311601 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.195557 Jul 11 21:07:44.540696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 465/942] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:44 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:45.558765 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9842f15d-fad5-4ad3-a4ac-a4028f2d0bac tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:45.560009 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9842f15d-fad5-4ad3-a4ac-a4028f2d0bac tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:45.582445 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9842f15d-fad5-4ad3-a4ac-a4028f2d0bac tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:45.583019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9842f15d-fad5-4ad3-a4ac-a4028f2d0bac tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:45.583808 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9842f15d-fad5-4ad3-a4ac-a4028f2d0bac tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:45.584345 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9842f15d-fad5-4ad3-a4ac-a4028f2d0bac tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:46.112489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9842f15d-fad5-4ad3-a4ac-a4028f2d0bac tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:46.121024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9842f15d-fad5-4ad3-a4ac-a4028f2d0bac tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.566701 Jul 11 21:07:46.121595 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 478/943] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:45 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:47.137400 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bc5d1f4e-9d23-415c-bee9-64d5828c53b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:47.138113 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bc5d1f4e-9d23-415c-bee9-64d5828c53b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:47.146522 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc5d1f4e-9d23-415c-bee9-64d5828c53b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:47.147240 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc5d1f4e-9d23-415c-bee9-64d5828c53b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:47.148042 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc5d1f4e-9d23-415c-bee9-64d5828c53b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:47.148538 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bc5d1f4e-9d23-415c-bee9-64d5828c53b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:47.325414 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-bc5d1f4e-9d23-415c-bee9-64d5828c53b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:47.340463 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bc5d1f4e-9d23-415c-bee9-64d5828c53b9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1265 microversion: 2.1 time: 0.206728 Jul 11 21:07:47.341111 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 466/944] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:47 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:07:48.357953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c31d5517-e561-4090-adaf-fc43045857ae tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:48.359227 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c31d5517-e561-4090-adaf-fc43045857ae tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:48.366115 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c31d5517-e561-4090-adaf-fc43045857ae tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:48.366776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c31d5517-e561-4090-adaf-fc43045857ae tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:48.367729 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c31d5517-e561-4090-adaf-fc43045857ae tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:48.368338 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c31d5517-e561-4090-adaf-fc43045857ae tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:48.540814 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c31d5517-e561-4090-adaf-fc43045857ae tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:48.557833 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c31d5517-e561-4090-adaf-fc43045857ae tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1453 microversion: 2.1 time: 0.203597 Jul 11 21:07:48.559031 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 479/945] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:48 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1453 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:48.580509 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5e5a4810-989c-4d0a-ae1b-9951b55e13c9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:48.581296 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5e5a4810-989c-4d0a-ae1b-9951b55e13c9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:48.590399 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5e5a4810-989c-4d0a-ae1b-9951b55e13c9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:48.591071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5e5a4810-989c-4d0a-ae1b-9951b55e13c9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:48.592076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5e5a4810-989c-4d0a-ae1b-9951b55e13c9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:48.593077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5e5a4810-989c-4d0a-ae1b-9951b55e13c9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:48.812850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5e5a4810-989c-4d0a-ae1b-9951b55e13c9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:07:48.823446 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5e5a4810-989c-4d0a-ae1b-9951b55e13c9 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1453 microversion: 2.1 time: 0.247894 Jul 11 21:07:48.824161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 467/946] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:07:48 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1453 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:07:51.443935 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-63f8b1c6-0bbb-46aa-b91d-3d453158a932 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:51.446770 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-63f8b1c6-0bbb-46aa-b91d-3d453158a932 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:51.451092 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:51.457074 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-63f8b1c6-0bbb-46aa-b91d-3d453158a932 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:51.457852 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-63f8b1c6-0bbb-46aa-b91d-3d453158a932 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:51.460005 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-63f8b1c6-0bbb-46aa-b91d-3d453158a932 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:51.461166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-63f8b1c6-0bbb-46aa-b91d-3d453158a932 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:51.498885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-63f8b1c6-0bbb-46aa-b91d-3d453158a932 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061769 Jul 11 21:07:51.499808 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 480/947] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:07:51 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:51.510500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1a50994c-4e74-4e09-9e0c-96ac071f8245 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:51.511098 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1a50994c-4e74-4e09-9e0c-96ac071f8245 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:51.517205 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:51.522438 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1a50994c-4e74-4e09-9e0c-96ac071f8245 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:51.523147 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1a50994c-4e74-4e09-9e0c-96ac071f8245 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:51.524056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1a50994c-4e74-4e09-9e0c-96ac071f8245 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:51.524915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1a50994c-4e74-4e09-9e0c-96ac071f8245 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:51.566108 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1a50994c-4e74-4e09-9e0c-96ac071f8245 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/26b32ae2-b786-45ff-a0a2-d286e41c22a1" status: 200 len: 194 microversion: 2.1 time: 0.060538 Jul 11 21:07:51.585716 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 468/948] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jul 11 21:07:51 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/26b32ae2-b786-45ff-a0a2-d286e41c22a1 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:52.242794 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-5ad8e7c3-bc4e-488e-9efe-2abd77127544 req-5bf1bbe8-b494-438e-86d1-3ad46d3bfd70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2606d8-c53b-4b15-a39d-5bb8f364ceb0", "tag": "1b700fff-4710-4b5d-b1f9-7e44e3268d34"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:52.255712 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-5ad8e7c3-bc4e-488e-9efe-2abd77127544 req-5bf1bbe8-b494-438e-86d1-3ad46d3bfd70 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:52.256558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-5ad8e7c3-bc4e-488e-9efe-2abd77127544 req-5bf1bbe8-b494-438e-86d1-3ad46d3bfd70 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:52.276167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-5ad8e7c3-bc4e-488e-9efe-2abd77127544 req-5bf1bbe8-b494-438e-86d1-3ad46d3bfd70 service nova] Creating event network-changed:1b700fff-4710-4b5d-b1f9-7e44e3268d34 for instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 on hv-cinder-84902 Jul 11 21:07:52.289191 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-5ad8e7c3-bc4e-488e-9efe-2abd77127544 req-5bf1bbe8-b494-438e-86d1-3ad46d3bfd70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055580 Jul 11 21:07:52.290083 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 481/949] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:52.981459 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-14102c3d-a7a2-4b38-a669-617d6d665ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:07:52.981939 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-14102c3d-a7a2-4b38-a669-617d6d665ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:52.989597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-14102c3d-a7a2-4b38-a669-617d6d665ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:52.990040 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-14102c3d-a7a2-4b38-a669-617d6d665ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:52.990810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-14102c3d-a7a2-4b38-a669-617d6d665ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:52.991249 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-14102c3d-a7a2-4b38-a669-617d6d665ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:53.045673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-14102c3d-a7a2-4b38-a669-617d6d665ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/ips" status: 200 len: 151 microversion: 2.1 time: 0.068188 Jul 11 21:07:53.049262 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 469/950] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 21:07:52 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/ips => generated 151 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:07:53.114602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-04828a2d-08ac-44ff-b7e5-730f235ba7dc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3e7dcaf-27ff-4f92-82c5-12271b0da8e5"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:53.116458 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-04828a2d-08ac-44ff-b7e5-730f235ba7dc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:53.128870 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-04828a2d-08ac-44ff-b7e5-730f235ba7dc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:53.129873 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-04828a2d-08ac-44ff-b7e5-730f235ba7dc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:53.134991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-04828a2d-08ac-44ff-b7e5-730f235ba7dc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:53.135584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-04828a2d-08ac-44ff-b7e5-730f235ba7dc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:53.455255 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2a7e3bb8-936d-4f1d-a0b7-a60932766332 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Action: 'create', calling method: .version_select at 0x7f38400e5310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1019997444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPErPZ2BKP20YlRC59EwdVQFSPxrSJDUg453ZLiSfHApaJ0eFtgLPz3akum88+nRJsTag8L+2lLWWHtuG19ot+ZaU6+TvULvXZtXSpYFuRsoRRup1dpi0Q3soFk5CgYobg=="}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:53.476750 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-2a7e3bb8-936d-4f1d-a0b7-a60932766332 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Getting quotas for project 3a26558aef284a9cbb955c7cdaa58e4e. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:07:53.480655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-2a7e3bb8-936d-4f1d-a0b7-a60932766332 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Getting quotas for user e3223a1d1dc1445c8b4aa118eb9747fd and project 3a26558aef284a9cbb955c7cdaa58e4e. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:07:53.565951 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2a7e3bb8-936d-4f1d-a0b7-a60932766332 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.410442 Jul 11 21:07:53.568145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 470/951] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 21:07:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:07:53.695302 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-04828a2d-08ac-44ff-b7e5-730f235ba7dc tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "POST /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.585335 Jul 11 21:07:53.695931 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 482/952] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:07:53 2022] POST /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments => generated 194 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:07:55.763340 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e3e008e6-985f-483f-b81f-8485f4d3194d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1830b2eb-3f97-43ce-86e3-3517caa594d5"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:07:55.764409 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e3e008e6-985f-483f-b81f-8485f4d3194d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:07:55.771794 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e3e008e6-985f-483f-b81f-8485f4d3194d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:55.772488 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e3e008e6-985f-483f-b81f-8485f4d3194d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:55.773289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e3e008e6-985f-483f-b81f-8485f4d3194d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:07:55.773715 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e3e008e6-985f-483f-b81f-8485f4d3194d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:07:56.063165 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e3e008e6-985f-483f-b81f-8485f4d3194d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304308 Jul 11 21:07:56.063775 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 471/953] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:07:55 2022] POST /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:02.670562 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b0598873-1ba2-468c-bd1f-d05299814baf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:02.672584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b0598873-1ba2-468c-bd1f-d05299814baf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:02.682769 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b0598873-1ba2-468c-bd1f-d05299814baf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:02.683475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b0598873-1ba2-468c-bd1f-d05299814baf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:02.684705 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b0598873-1ba2-468c-bd1f-d05299814baf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:02.685363 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b0598873-1ba2-468c-bd1f-d05299814baf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:02.716227 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b0598873-1ba2-468c-bd1f-d05299814baf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052191 Jul 11 21:08:02.716742 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 483/954] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:08:02 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:02.864273 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-75d5507b-f7e2-4ba6-8cfe-70f819a6f45b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:02.864850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-75d5507b-f7e2-4ba6-8cfe-70f819a6f45b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:02.871614 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75d5507b-f7e2-4ba6-8cfe-70f819a6f45b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:02.872053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75d5507b-f7e2-4ba6-8cfe-70f819a6f45b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:02.872845 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75d5507b-f7e2-4ba6-8cfe-70f819a6f45b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:02.873272 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75d5507b-f7e2-4ba6-8cfe-70f819a6f45b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:02.903764 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-75d5507b-f7e2-4ba6-8cfe-70f819a6f45b tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/26b32ae2-b786-45ff-a0a2-d286e41c22a1" status: 200 len: 194 microversion: 2.1 time: 0.044675 Jul 11 21:08:02.904386 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 472/955] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jul 11 21:08:02 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/26b32ae2-b786-45ff-a0a2-d286e41c22a1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:02.915311 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-95d850d5-d204-4ae1-9965-f92d559afeea tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:02.915910 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-95d850d5-d204-4ae1-9965-f92d559afeea tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:02.922904 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-95d850d5-d204-4ae1-9965-f92d559afeea tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:02.923333 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-95d850d5-d204-4ae1-9965-f92d559afeea tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:02.924132 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-95d850d5-d204-4ae1-9965-f92d559afeea tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:02.924551 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-95d850d5-d204-4ae1-9965-f92d559afeea tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:03.011665 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-95d850d5-d204-4ae1-9965-f92d559afeea tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lazy-loading 'services' on Instance uuid 582e2e88-f321-4be4-8030-ce7a59d27211 {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:08:03.092096 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-95d850d5-d204-4ae1-9965-f92d559afeea tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "DELETE /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/26b32ae2-b786-45ff-a0a2-d286e41c22a1" status: 202 len: 0 microversion: 2.1 time: 0.180665 Jul 11 21:08:03.092723 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 484/956] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:08:02 2022] DELETE /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/26b32ae2-b786-45ff-a0a2-d286e41c22a1 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:08:09.966954 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-18db0337-9131-4679-b222-38c7e12441bf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: .version_select at 0x7f3840399c10>, body: {"keypair": {"name": "tempest-keypair-1049147502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfktkkN/WEW5Re2MchRpu1H2qRIbdWwrY7zya5z8yehuVIuNU6np6Uj+A9UWLlNCwWr6AEyDbh52QPBPgtrwJaSV05WyEK/nYg20To6dkiXQmALlOE5ivyay99MAMqM0A=="}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:09.971554 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=4 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:09.984691 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-18db0337-9131-4679-b222-38c7e12441bf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:08:09.989925 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-18db0337-9131-4679-b222-38c7e12441bf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for user 68f6997db7c141529c37cc64955df779 and project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:08:10.016028 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-18db0337-9131-4679-b222-38c7e12441bf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053017 Jul 11 21:08:10.016770 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 473/957] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 21:08:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:11.588446 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1293756360", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "681ae82c-3a6d-44f5-9bef-155f92884bde"}], "security_groups": [{"name": "tempest-securitygroup--732494969"}], "key_name": "tempest-keypair-1049147502", "user_data": "}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:11.656189 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-fbe98cfa-8231-481e-b297-ca8beb80c0b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:11.656763 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-fbe98cfa-8231-481e-b297-ca8beb80c0b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:11.663809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbe98cfa-8231-481e-b297-ca8beb80c0b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:11.664477 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbe98cfa-8231-481e-b297-ca8beb80c0b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:11.665523 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbe98cfa-8231-481e-b297-ca8beb80c0b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:11.666118 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-fbe98cfa-8231-481e-b297-ca8beb80c0b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:11.695181 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.network.neutron [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] validate_networks() for [('681ae82c-3a6d-44f5-9bef-155f92884bde', None, None, None, None, None)] {{(pid=118013) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:08:11.697502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-fbe98cfa-8231-481e-b297-ca8beb80c0b5 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/a3e7dcaf-27ff-4f92-82c5-12271b0da8e5" status: 200 len: 194 microversion: 2.1 time: 0.045405 Jul 11 21:08:11.698111 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 474/958] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jul 11 21:08:11 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/a3e7dcaf-27ff-4f92-82c5-12271b0da8e5 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:11.707863 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c59a290c-9b2d-4693-8582-3d1c9e8a3d7d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:11.708349 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c59a290c-9b2d-4693-8582-3d1c9e8a3d7d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:11.714405 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c59a290c-9b2d-4693-8582-3d1c9e8a3d7d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:11.714851 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c59a290c-9b2d-4693-8582-3d1c9e8a3d7d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:11.715897 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c59a290c-9b2d-4693-8582-3d1c9e8a3d7d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:11.716327 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c59a290c-9b2d-4693-8582-3d1c9e8a3d7d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:11.797747 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-c59a290c-9b2d-4693-8582-3d1c9e8a3d7d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lazy-loading 'services' on Instance uuid 582e2e88-f321-4be4-8030-ce7a59d27211 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:08:11.873123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c59a290c-9b2d-4693-8582-3d1c9e8a3d7d tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "DELETE /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/a3e7dcaf-27ff-4f92-82c5-12271b0da8e5" status: 202 len: 0 microversion: 2.1 time: 0.168974 Jul 11 21:08:11.873719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 475/959] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:08:11 2022] DELETE /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments/a3e7dcaf-27ff-4f92-82c5-12271b0da8e5 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:08:12.093146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Flavor limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:08:12.093564 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Image limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:08:12.094028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Flavor pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:08:12.094430 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Image pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:08:12.094831 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:08:12.105074 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:12.105493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:12.106313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:12.106737 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:12.113414 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:12.128685 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:08:12.133763 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for user 68f6997db7c141529c37cc64955df779 and project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:08:12.146629 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Going to run 1 instances... {{(pid=118013) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:08:12.149002 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118013) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:08:12.200064 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9f6debd3-fa11-48b2-8aa6-1e69dd528c00 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.616950 Jul 11 21:08:12.200998 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 485/960] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:08:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:08:12.212001 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c96b6e7f-b59e-4d99-9c8d-fe60ae66bbd4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:12.212732 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c96b6e7f-b59e-4d99-9c8d-fe60ae66bbd4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:12.270145 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c96b6e7f-b59e-4d99-9c8d-fe60ae66bbd4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:12.276985 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c96b6e7f-b59e-4d99-9c8d-fe60ae66bbd4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1242 microversion: 2.1 time: 0.069768 Jul 11 21:08:12.277595 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 476/961] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:12 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:13.294840 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-09086382-950c-49d2-8472-afe10ab5c3aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:13.296041 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-09086382-950c-49d2-8472-afe10ab5c3aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:13.304737 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09086382-950c-49d2-8472-afe10ab5c3aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:13.305183 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09086382-950c-49d2-8472-afe10ab5c3aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:13.305933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09086382-950c-49d2-8472-afe10ab5c3aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:13.306626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-09086382-950c-49d2-8472-afe10ab5c3aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:13.373686 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-09086382-950c-49d2-8472-afe10ab5c3aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:13.381830 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-09086382-950c-49d2-8472-afe10ab5c3aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1294 microversion: 2.1 time: 0.091280 Jul 11 21:08:13.382568 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 486/962] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:13 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:14.094753 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ca9bcb27-31b5-42d2-99c7-fe4efaa4f8c8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:14.095794 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ca9bcb27-31b5-42d2-99c7-fe4efaa4f8c8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:14.103975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca9bcb27-31b5-42d2-99c7-fe4efaa4f8c8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.104456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca9bcb27-31b5-42d2-99c7-fe4efaa4f8c8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.105232 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca9bcb27-31b5-42d2-99c7-fe4efaa4f8c8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.105658 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ca9bcb27-31b5-42d2-99c7-fe4efaa4f8c8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.109474 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:14.139233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ca9bcb27-31b5-42d2-99c7-fe4efaa4f8c8 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048843 Jul 11 21:08:14.139916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 477/963] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:08:14 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 21:08:14.246930 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-68bccc9d-c295-4e79-9beb-c20db559e6bf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:14.247914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-68bccc9d-c295-4e79-9beb-c20db559e6bf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:14.254275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68bccc9d-c295-4e79-9beb-c20db559e6bf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.254520 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68bccc9d-c295-4e79-9beb-c20db559e6bf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.255481 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68bccc9d-c295-4e79-9beb-c20db559e6bf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.255946 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68bccc9d-c295-4e79-9beb-c20db559e6bf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.286231 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-68bccc9d-c295-4e79-9beb-c20db559e6bf tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043250 Jul 11 21:08:14.286793 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 487/964] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:08:14 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 21:08:14.348561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-825b3ee0-c553-45ee-98d1-2fef79809d57 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:14.349061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-825b3ee0-c553-45ee-98d1-2fef79809d57 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:14.357151 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-825b3ee0-c553-45ee-98d1-2fef79809d57 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.357596 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-825b3ee0-c553-45ee-98d1-2fef79809d57 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.358562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-825b3ee0-c553-45ee-98d1-2fef79809d57 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.359152 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-825b3ee0-c553-45ee-98d1-2fef79809d57 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.391620 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-825b3ee0-c553-45ee-98d1-2fef79809d57 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:08:14.401349 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-7f3a52ce-b732-4ed6-bdae-afece0a56166 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:14.401933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-7f3a52ce-b732-4ed6-bdae-afece0a56166 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:14.410202 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7f3a52ce-b732-4ed6-bdae-afece0a56166 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.410655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7f3a52ce-b732-4ed6-bdae-afece0a56166 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.411438 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7f3a52ce-b732-4ed6-bdae-afece0a56166 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.411870 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-7f3a52ce-b732-4ed6-bdae-afece0a56166 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.495359 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-825b3ee0-c553-45ee-98d1-2fef79809d57 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "DELETE /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 204 len: 0 microversion: 2.1 time: 0.150445 Jul 11 21:08:14.496491 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 478/965] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:08:14 2022] DELETE /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:08:14.517824 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-650c4ed2-14cc-4a8c-a7c8-71a8b1771eeb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:14.519180 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-650c4ed2-14cc-4a8c-a7c8-71a8b1771eeb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:14.528042 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-650c4ed2-14cc-4a8c-a7c8-71a8b1771eeb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.528614 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-650c4ed2-14cc-4a8c-a7c8-71a8b1771eeb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.529529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-650c4ed2-14cc-4a8c-a7c8-71a8b1771eeb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:14.530059 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-650c4ed2-14cc-4a8c-a7c8-71a8b1771eeb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:14.594708 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-7f3a52ce-b732-4ed6-bdae-afece0a56166 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:14.602509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-7f3a52ce-b732-4ed6-bdae-afece0a56166 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.206939 Jul 11 21:08:14.603093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 488/966] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:14 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:14.790386 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-650c4ed2-14cc-4a8c-a7c8-71a8b1771eeb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:14.798349 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-650c4ed2-14cc-4a8c-a7c8-71a8b1771eeb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1672 microversion: 2.1 time: 0.290267 Jul 11 21:08:14.798908 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 479/967] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:14 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1672 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:15.249518 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-1edb6f36-ffe3-4520-a305-ab7426db17c6 req-0a797826-35ce-4e24-93e2-85217e97447e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861d2bea-e420-47e3-95f6-6dcfde4e7d88", "tag": "80759534-ed8a-4ac4-99d1-330bda28ad63"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:15.258786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-1edb6f36-ffe3-4520-a305-ab7426db17c6 req-0a797826-35ce-4e24-93e2-85217e97447e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:15.258786 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-1edb6f36-ffe3-4520-a305-ab7426db17c6 req-0a797826-35ce-4e24-93e2-85217e97447e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:15.270614 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-1edb6f36-ffe3-4520-a305-ab7426db17c6 req-0a797826-35ce-4e24-93e2-85217e97447e service nova] Creating event network-changed:80759534-ed8a-4ac4-99d1-330bda28ad63 for instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 on hv-cinder-84902 Jul 11 21:08:15.276052 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-1edb6f36-ffe3-4520-a305-ab7426db17c6 req-0a797826-35ce-4e24-93e2-85217e97447e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030471 Jul 11 21:08:15.277020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 489/968] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:15.619851 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-272c94a4-5b48-4c34-8e4d-f6143b598218 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:15.620669 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-272c94a4-5b48-4c34-8e4d-f6143b598218 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:15.628412 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-272c94a4-5b48-4c34-8e4d-f6143b598218 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:15.628827 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-272c94a4-5b48-4c34-8e4d-f6143b598218 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:15.629586 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-272c94a4-5b48-4c34-8e4d-f6143b598218 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:15.630015 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-272c94a4-5b48-4c34-8e4d-f6143b598218 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:15.766783 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-272c94a4-5b48-4c34-8e4d-f6143b598218 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:15.774926 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-272c94a4-5b48-4c34-8e4d-f6143b598218 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.159497 Jul 11 21:08:15.775474 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 480/969] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:15 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:15.819376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-734f0a39-72f9-473e-914e-e415e46728b3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:15.820082 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-734f0a39-72f9-473e-914e-e415e46728b3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:15.828489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-734f0a39-72f9-473e-914e-e415e46728b3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:15.828954 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-734f0a39-72f9-473e-914e-e415e46728b3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:15.829715 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-734f0a39-72f9-473e-914e-e415e46728b3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:15.830154 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-734f0a39-72f9-473e-914e-e415e46728b3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:15.961337 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-734f0a39-72f9-473e-914e-e415e46728b3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:15.969096 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-734f0a39-72f9-473e-914e-e415e46728b3 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1672 microversion: 2.1 time: 0.154965 Jul 11 21:08:15.969635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 490/970] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:15 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:16.797786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-137eb737-d34e-4dbe-9b11-792ba68f0837 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:16.798418 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-137eb737-d34e-4dbe-9b11-792ba68f0837 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:16.805922 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-137eb737-d34e-4dbe-9b11-792ba68f0837 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:16.806373 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-137eb737-d34e-4dbe-9b11-792ba68f0837 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:16.807148 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-137eb737-d34e-4dbe-9b11-792ba68f0837 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:16.807583 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-137eb737-d34e-4dbe-9b11-792ba68f0837 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:16.991320 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-58443a39-4e14-4f18-a78a-6f7ecdc40057 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:16.991889 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-58443a39-4e14-4f18-a78a-6f7ecdc40057 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:16.998953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58443a39-4e14-4f18-a78a-6f7ecdc40057 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:16.999387 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58443a39-4e14-4f18-a78a-6f7ecdc40057 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:17.000148 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58443a39-4e14-4f18-a78a-6f7ecdc40057 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:17.000613 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58443a39-4e14-4f18-a78a-6f7ecdc40057 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:17.139190 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-58443a39-4e14-4f18-a78a-6f7ecdc40057 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:17.147056 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-58443a39-4e14-4f18-a78a-6f7ecdc40057 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1672 microversion: 2.1 time: 0.159827 Jul 11 21:08:17.147822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 491/971] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:16 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:17.178143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-137eb737-d34e-4dbe-9b11-792ba68f0837 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:17.189339 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-137eb737-d34e-4dbe-9b11-792ba68f0837 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.395599 Jul 11 21:08:17.190101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 481/972] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:16 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:18.165671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-538d11a0-a2d0-4727-b855-ddda3971752f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:18.166244 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-538d11a0-a2d0-4727-b855-ddda3971752f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:18.173515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-538d11a0-a2d0-4727-b855-ddda3971752f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:18.173965 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-538d11a0-a2d0-4727-b855-ddda3971752f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:18.176095 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-538d11a0-a2d0-4727-b855-ddda3971752f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:18.176095 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-538d11a0-a2d0-4727-b855-ddda3971752f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:18.211392 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7f54a367-dca4-4eeb-9fb0-35325399cd20 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:18.212276 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7f54a367-dca4-4eeb-9fb0-35325399cd20 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:18.219114 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7f54a367-dca4-4eeb-9fb0-35325399cd20 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:18.219653 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7f54a367-dca4-4eeb-9fb0-35325399cd20 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:18.220605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7f54a367-dca4-4eeb-9fb0-35325399cd20 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:18.221100 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7f54a367-dca4-4eeb-9fb0-35325399cd20 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:18.309547 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-538d11a0-a2d0-4727-b855-ddda3971752f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:18.317287 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-538d11a0-a2d0-4727-b855-ddda3971752f tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1672 microversion: 2.1 time: 0.156217 Jul 11 21:08:18.317862 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 492/973] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:18 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:18.559766 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-7f54a367-dca4-4eeb-9fb0-35325399cd20 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:18.569008 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7f54a367-dca4-4eeb-9fb0-35325399cd20 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.361822 Jul 11 21:08:18.570117 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 482/974] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:18 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:19.140935 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-debb7fbb-b080-4433-bda8-3c18ab2d3edd req-af7ecdf5-20c1-46ec-a58e-aa1b99eba7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e2e88-f321-4be4-8030-ce7a59d27211", "name": "network-vif-deleted", "tag": "1edf8c56-e0a4-46ea-a0ea-b8208cec4797"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:19.149198 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-debb7fbb-b080-4433-bda8-3c18ab2d3edd req-af7ecdf5-20c1-46ec-a58e-aa1b99eba7cc service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:19.149633 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-debb7fbb-b080-4433-bda8-3c18ab2d3edd req-af7ecdf5-20c1-46ec-a58e-aa1b99eba7cc service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:19.163283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-debb7fbb-b080-4433-bda8-3c18ab2d3edd req-af7ecdf5-20c1-46ec-a58e-aa1b99eba7cc service nova] Creating event network-vif-deleted:1edf8c56-e0a4-46ea-a0ea-b8208cec4797 for instance 582e2e88-f321-4be4-8030-ce7a59d27211 on hv-cinder-84902 Jul 11 21:08:19.168262 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-debb7fbb-b080-4433-bda8-3c18ab2d3edd req-af7ecdf5-20c1-46ec-a58e-aa1b99eba7cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031068 Jul 11 21:08:19.169193 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 493/975] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:19.334865 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-491101ab-b72f-405e-9b1f-a1c91ad617fa tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:19.335798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-491101ab-b72f-405e-9b1f-a1c91ad617fa tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:19.342551 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-491101ab-b72f-405e-9b1f-a1c91ad617fa tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:19.343009 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-491101ab-b72f-405e-9b1f-a1c91ad617fa tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:19.343841 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-491101ab-b72f-405e-9b1f-a1c91ad617fa tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:19.344396 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-491101ab-b72f-405e-9b1f-a1c91ad617fa tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:19.409745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-491101ab-b72f-405e-9b1f-a1c91ad617fa tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:19.417591 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-491101ab-b72f-405e-9b1f-a1c91ad617fa tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1605 microversion: 2.1 time: 0.086802 Jul 11 21:08:19.418191 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 483/976] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:19 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1605 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:19.587817 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6209c5ae-4608-43d1-94bb-18c8007d0f44 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:19.588468 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6209c5ae-4608-43d1-94bb-18c8007d0f44 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:19.595328 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6209c5ae-4608-43d1-94bb-18c8007d0f44 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:19.595929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6209c5ae-4608-43d1-94bb-18c8007d0f44 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:19.596834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6209c5ae-4608-43d1-94bb-18c8007d0f44 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:19.597544 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6209c5ae-4608-43d1-94bb-18c8007d0f44 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:19.737981 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6209c5ae-4608-43d1-94bb-18c8007d0f44 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:19.745789 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6209c5ae-4608-43d1-94bb-18c8007d0f44 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.162793 Jul 11 21:08:19.746334 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 494/977] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:19 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:20.439595 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-815b2b54-a7d8-4fd2-a2ce-0e4ed6573833 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:20.440503 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-815b2b54-a7d8-4fd2-a2ce-0e4ed6573833 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:20.451839 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-815b2b54-a7d8-4fd2-a2ce-0e4ed6573833 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:20.452632 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-815b2b54-a7d8-4fd2-a2ce-0e4ed6573833 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:20.453898 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-815b2b54-a7d8-4fd2-a2ce-0e4ed6573833 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:20.454657 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-815b2b54-a7d8-4fd2-a2ce-0e4ed6573833 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:20.532941 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-815b2b54-a7d8-4fd2-a2ce-0e4ed6573833 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:20.541258 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-815b2b54-a7d8-4fd2-a2ce-0e4ed6573833 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1605 microversion: 2.1 time: 0.108262 Jul 11 21:08:20.542214 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 484/978] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:20 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1605 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:20.765965 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-087778f5-9c23-4686-ac97-55ffc33a9a74 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:20.766950 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-087778f5-9c23-4686-ac97-55ffc33a9a74 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:20.778226 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-087778f5-9c23-4686-ac97-55ffc33a9a74 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:20.778973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-087778f5-9c23-4686-ac97-55ffc33a9a74 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:20.780270 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-087778f5-9c23-4686-ac97-55ffc33a9a74 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:20.780994 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-087778f5-9c23-4686-ac97-55ffc33a9a74 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:20.918985 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-087778f5-9c23-4686-ac97-55ffc33a9a74 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:20.927530 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-087778f5-9c23-4686-ac97-55ffc33a9a74 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.168062 Jul 11 21:08:20.928123 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 495/979] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:20 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:21.563754 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b4bc5ec4-0dd0-4239-afd5-3392060725cb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:21.564370 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-b4bc5ec4-0dd0-4239-afd5-3392060725cb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:21.567362 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:21.572719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b4bc5ec4-0dd0-4239-afd5-3392060725cb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:21.573174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b4bc5ec4-0dd0-4239-afd5-3392060725cb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:21.573987 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b4bc5ec4-0dd0-4239-afd5-3392060725cb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:21.574420 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b4bc5ec4-0dd0-4239-afd5-3392060725cb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:21.636683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-b4bc5ec4-0dd0-4239-afd5-3392060725cb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:21.644530 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b4bc5ec4-0dd0-4239-afd5-3392060725cb tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1605 microversion: 2.1 time: 0.086746 Jul 11 21:08:21.645104 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 485/980] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:21 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:21.753537 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1324802154", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1019997444", "security_groups": [{"name": "tempest-secgroup-smoke-1707203425"}], "networks": [{"uuid": "5d7f4858-6c2c-4e36-806b-67a999902760"}], "block_device_mapping_v2": [{"uuid": "e011eefe-3e62-4f61-9458-c48a4b4aa629", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:21.761581 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:21.890436 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.network.neutron [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] validate_networks() for [('5d7f4858-6c2c-4e36-806b-67a999902760', None, None, None, None, None)] {{(pid=118013) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:08:21.945290 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-569845fa-ea29-4321-906b-7af614b77557 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:21.945889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-569845fa-ea29-4321-906b-7af614b77557 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:21.952346 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-569845fa-ea29-4321-906b-7af614b77557 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:21.952793 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-569845fa-ea29-4321-906b-7af614b77557 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:21.953553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-569845fa-ea29-4321-906b-7af614b77557 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:21.953980 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-569845fa-ea29-4321-906b-7af614b77557 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:22.086267 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-569845fa-ea29-4321-906b-7af614b77557 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:22.094016 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-569845fa-ea29-4321-906b-7af614b77557 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.153113 Jul 11 21:08:22.094692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 486/981] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:21 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:22.113820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:22.140840 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=6 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:22.289313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Flavor limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:08:22.289924 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Image limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:08:22.290678 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Flavor pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:08:22.291342 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Image pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:08:22.292015 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:08:22.306083 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:22.306679 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:22.307789 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:22.308457 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:22.327789 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Getting quotas for project 3a26558aef284a9cbb955c7cdaa58e4e. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:08:22.332300 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Getting quotas for user e3223a1d1dc1445c8b4aa118eb9747fd and project 3a26558aef284a9cbb955c7cdaa58e4e. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:08:22.391591 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Going to run 1 instances... {{(pid=118013) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:08:22.393749 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e011eefe-3e62-4f61-9458-c48a4b4aa629',volume_size=None,volume_type=None)] {{(pid=118013) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:08:22.537443 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6a665b02-c34e-40f8-baf5-06b6f9d77c26 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787878 Jul 11 21:08:22.538928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 496/982] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:08:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:08:22.549703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-328f04b3-24a8-4266-922d-69ed854c0c5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:22.550250 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-328f04b3-24a8-4266-922d-69ed854c0c5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:22.556258 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:22.614534 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-328f04b3-24a8-4266-922d-69ed854c0c5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:22.621601 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-328f04b3-24a8-4266-922d-69ed854c0c5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1089 microversion: 2.1 time: 0.076576 Jul 11 21:08:22.622181 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 487/983] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:22 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:22.662145 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:22.663027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:22.670515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:22.670963 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:22.671720 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:22.672558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:22.703555 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:22.704015 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:22.704482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lazy-loading 'fault' on Instance uuid 582e2e88-f321-4be4-8030-ce7a59d27211 {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:08:22.750244 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965444614ae486e80e111f4126b52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367a52be93e24b5eaf528a48342d47b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:22.758359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e02ab45f-21d6-4c8a-857d-28d21f1fb6e1 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 200 len: 1327 microversion: 2.1 time: 0.100591 Jul 11 21:08:22.765535 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 497/984] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:22 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:23.110782 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-48ed5bc5-1321-4768-b202-ac1bd156600b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:23.111391 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-48ed5bc5-1321-4768-b202-ac1bd156600b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:23.118881 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-48ed5bc5-1321-4768-b202-ac1bd156600b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:23.119272 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-48ed5bc5-1321-4768-b202-ac1bd156600b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:23.120044 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-48ed5bc5-1321-4768-b202-ac1bd156600b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:23.120537 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-48ed5bc5-1321-4768-b202-ac1bd156600b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:23.255559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-48ed5bc5-1321-4768-b202-ac1bd156600b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:23.268847 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-48ed5bc5-1321-4768-b202-ac1bd156600b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.161888 Jul 11 21:08:23.269443 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 488/985] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:23 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:23.638892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1f992744-ee75-46bd-9f1b-edaded7f44ab tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:23.639489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1f992744-ee75-46bd-9f1b-edaded7f44ab tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:23.648409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f992744-ee75-46bd-9f1b-edaded7f44ab tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:23.648996 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f992744-ee75-46bd-9f1b-edaded7f44ab tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:23.650087 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f992744-ee75-46bd-9f1b-edaded7f44ab tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:23.650693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1f992744-ee75-46bd-9f1b-edaded7f44ab tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:23.723102 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1f992744-ee75-46bd-9f1b-edaded7f44ab tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:23.730971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1f992744-ee75-46bd-9f1b-edaded7f44ab tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1195 microversion: 2.1 time: 0.096332 Jul 11 21:08:23.731562 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 498/986] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:23 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1195 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:23.777157 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:23.778298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:23.785110 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:23.785943 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:23.786770 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:23.787210 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:23.801827 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] HTTP exception thrown: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Request method failure captured: Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 HTTP/1.1 Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI6-_4zfdvQN9fJEMl4UEvMWtB8x8f-2irLg7Rz3SIuKsnm0VDrz9Xg79CBJpB5ePJeIElcdQc1aaw-qIcTbtRftjY1QHVke1UVVoO766ShN4f4NAudN6yZOV8NJjVY0_w-Zvf_r6nLndKryWVjhzNiGeZSsFHQigf58He62TYU3V7E Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:08:23.803510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_367a52be93e24b5eaf528a48342d47b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 0965444614ae486e80e111f4126b52f1 Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:23.804992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '582e2e88-f321-4be4-8030-ce7a59d27211'} Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:08:23.805944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:23.807633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:23.809415 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Returning 404 to user: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:08:23.809415 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7567f805-13b4-4b4c-889d-6a7212668b23 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 404 len: 111 microversion: 2.1 time: 0.032760 Jul 11 21:08:23.809415 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 489/987] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:23 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:23.814114 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1f2dbe08-18c9-492d-a044-fd31aaaf2c71 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '.version_select at 0x7f38400f3a60>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:23.836824 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1f2dbe08-18c9-492d-a044-fd31aaaf2c71 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474803676" status: 202 len: 0 microversion: 2.1 time: 0.026559 Jul 11 21:08:23.837941 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 499/988] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jul 11 21:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474803676 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 21:08:24.286621 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cf0182fb-1ade-435e-a5b1-86c342c035e8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:24.287593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cf0182fb-1ade-435e-a5b1-86c342c035e8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:24.294539 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf0182fb-1ade-435e-a5b1-86c342c035e8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:24.295353 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf0182fb-1ade-435e-a5b1-86c342c035e8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:24.296393 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf0182fb-1ade-435e-a5b1-86c342c035e8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:24.297445 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf0182fb-1ade-435e-a5b1-86c342c035e8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:24.531662 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-cf0182fb-1ade-435e-a5b1-86c342c035e8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:24.544537 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cf0182fb-1ade-435e-a5b1-86c342c035e8 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.261535 Jul 11 21:08:24.555901 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 490/989] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:24 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:24.755014 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3607d9ba-2941-48e2-af24-206c184476f4 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:24.756063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3607d9ba-2941-48e2-af24-206c184476f4 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:24.765306 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3607d9ba-2941-48e2-af24-206c184476f4 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:24.766040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3607d9ba-2941-48e2-af24-206c184476f4 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:24.767531 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3607d9ba-2941-48e2-af24-206c184476f4 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:24.768541 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3607d9ba-2941-48e2-af24-206c184476f4 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:24.932013 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3607d9ba-2941-48e2-af24-206c184476f4 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:24.939547 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3607d9ba-2941-48e2-af24-206c184476f4 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.193453 Jul 11 21:08:24.940805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 500/990] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:24 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:25.482951 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-4fad7dea-8210-4a08-b725-b96e64dba3f8 req-f713e2b2-e304-401f-b7f1-cf4873ce21ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bea7e51-186a-4c52-a94a-9470dc903c21", "tag": "e0b24542-e2ec-4ba9-8dad-b15749bd5e76"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:25.497697 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-4fad7dea-8210-4a08-b725-b96e64dba3f8 req-f713e2b2-e304-401f-b7f1-cf4873ce21ae service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:25.498140 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-4fad7dea-8210-4a08-b725-b96e64dba3f8 req-f713e2b2-e304-401f-b7f1-cf4873ce21ae service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:25.510875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-4fad7dea-8210-4a08-b725-b96e64dba3f8 req-f713e2b2-e304-401f-b7f1-cf4873ce21ae service nova] Creating event network-changed:e0b24542-e2ec-4ba9-8dad-b15749bd5e76 for instance 4bea7e51-186a-4c52-a94a-9470dc903c21 on hv-cinder-84902 Jul 11 21:08:25.515616 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-4fad7dea-8210-4a08-b725-b96e64dba3f8 req-f713e2b2-e304-401f-b7f1-cf4873ce21ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043373 Jul 11 21:08:25.516259 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 491/991] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:25.562682 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5945edc4-7276-4fb7-862a-be766158062d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:25.563643 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5945edc4-7276-4fb7-862a-be766158062d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:25.570163 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5945edc4-7276-4fb7-862a-be766158062d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:25.570713 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5945edc4-7276-4fb7-862a-be766158062d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:25.571767 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5945edc4-7276-4fb7-862a-be766158062d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:25.572638 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5945edc4-7276-4fb7-862a-be766158062d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:25.732475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5945edc4-7276-4fb7-862a-be766158062d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:25.740165 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5945edc4-7276-4fb7-862a-be766158062d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.181295 Jul 11 21:08:25.740765 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 501/992] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:25 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:08:25.958277 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c2034589-92c1-45b8-9d91-e65e3935c54e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:25.959246 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c2034589-92c1-45b8-9d91-e65e3935c54e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:25.966852 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c2034589-92c1-45b8-9d91-e65e3935c54e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:25.967207 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c2034589-92c1-45b8-9d91-e65e3935c54e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:25.967998 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c2034589-92c1-45b8-9d91-e65e3935c54e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:25.968435 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c2034589-92c1-45b8-9d91-e65e3935c54e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:26.109111 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c2034589-92c1-45b8-9d91-e65e3935c54e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:26.117112 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c2034589-92c1-45b8-9d91-e65e3935c54e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.163146 Jul 11 21:08:26.117686 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 492/993] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:25 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:26.757874 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-af597ce4-e276-4ab2-8b52-dc767dff2932 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:26.758460 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-a8f846d9-c49e-431e-92a0-4900f921b6b2 req-6a5e7cf1-ea93-4821-b414-f12043a2922e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861d2bea-e420-47e3-95f6-6dcfde4e7d88", "name": "network-vif-plugged", "status": "completed", "tag": "80759534-ed8a-4ac4-99d1-330bda28ad63"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:26.758841 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-af597ce4-e276-4ab2-8b52-dc767dff2932 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:26.766240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af597ce4-e276-4ab2-8b52-dc767dff2932 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:26.766934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af597ce4-e276-4ab2-8b52-dc767dff2932 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:26.767581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-a8f846d9-c49e-431e-92a0-4900f921b6b2 req-6a5e7cf1-ea93-4821-b414-f12043a2922e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:26.768030 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-a8f846d9-c49e-431e-92a0-4900f921b6b2 req-6a5e7cf1-ea93-4821-b414-f12043a2922e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:26.768487 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af597ce4-e276-4ab2-8b52-dc767dff2932 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:26.769113 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af597ce4-e276-4ab2-8b52-dc767dff2932 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:26.780843 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-a8f846d9-c49e-431e-92a0-4900f921b6b2 req-6a5e7cf1-ea93-4821-b414-f12043a2922e service nova] Creating event network-vif-plugged:80759534-ed8a-4ac4-99d1-330bda28ad63 for instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 on hv-cinder-84902 Jul 11 21:08:26.785834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-a8f846d9-c49e-431e-92a0-4900f921b6b2 req-6a5e7cf1-ea93-4821-b414-f12043a2922e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031684 Jul 11 21:08:26.786809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 493/994] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:26.904903 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-af597ce4-e276-4ab2-8b52-dc767dff2932 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:26.916815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-af597ce4-e276-4ab2-8b52-dc767dff2932 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.162616 Jul 11 21:08:26.917682 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 502/995] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:26 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:27.032997 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:27.033587 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:27.040854 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:27.041305 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:27.042079 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:27.042521 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:27.057186 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] HTTP exception thrown: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Request method failure captured: Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: DELETE /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 HTTP/1.1 Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI6-_4zfdvQN9fJEMl4UEvMWtB8x8f-2irLg7Rz3SIuKsnm0VDrz9Xg79CBJpB5ePJeIElcdQc1aaw-qIcTbtRftjY1QHVke1UVVoO766ShN4f4NAudN6yZOV8NJjVY0_w-Zvf_r6nLndKryWVjhzNiGeZSsFHQigf58He62TYU3V7E Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:08:27.058850 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_367a52be93e24b5eaf528a48342d47b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 0965444614ae486e80e111f4126b52f1 Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.060382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '582e2e88-f321-4be4-8030-ce7a59d27211'} Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:08:27.061129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.062452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.064056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Returning 404 to user: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:08:27.064056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d66469e6-6e60-42b0-a620-e89aa4c5c018 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "DELETE /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 404 len: 111 microversion: 2.1 time: 0.031584 Jul 11 21:08:27.064056 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 494/996] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:08:27 2022] DELETE /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:27.071423 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:27.072189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 582e2e88-f321-4be4-8030-ce7a59d27211] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:27.081748 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:27.082394 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:27.083280 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:27.083710 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:27.097033 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] HTTP exception thrown: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Request method failure captured: Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 HTTP/1.1 Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI6-_4zfdvQN9fJEMl4UEvMWtB8x8f-2irLg7Rz3SIuKsnm0VDrz9Xg79CBJpB5ePJeIElcdQc1aaw-qIcTbtRftjY1QHVke1UVVoO766ShN4f4NAudN6yZOV8NJjVY0_w-Zvf_r6nLndKryWVjhzNiGeZSsFHQigf58He62TYU3V7E Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:08:27.098798 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_367a52be93e24b5eaf528a48342d47b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 0965444614ae486e80e111f4126b52f1 Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.100448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '582e2e88-f321-4be4-8030-ce7a59d27211'} Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:08:27.101245 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. Jul 11 21:08:27.102474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:27.103552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Returning 404 to user: Instance 582e2e88-f321-4be4-8030-ce7a59d27211 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:08:27.103552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-041e91cd-da3b-46ec-9dd0-ed1a9fb82976 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211" status: 404 len: 111 microversion: 2.1 time: 0.035084 Jul 11 21:08:27.103552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 503/997] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:27 2022] GET /compute/v2.1/servers/582e2e88-f321-4be4-8030-ce7a59d27211 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:27.133975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1d9e232d-9a60-41bf-975c-974834a63e40 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:27.134579 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1d9e232d-9a60-41bf-975c-974834a63e40 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:27.141381 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1d9e232d-9a60-41bf-975c-974834a63e40 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:27.141992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1d9e232d-9a60-41bf-975c-974834a63e40 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:27.142925 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1d9e232d-9a60-41bf-975c-974834a63e40 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:27.143356 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1d9e232d-9a60-41bf-975c-974834a63e40 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:27.286528 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1d9e232d-9a60-41bf-975c-974834a63e40 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:27.288932 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:27.297639 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1d9e232d-9a60-41bf-975c-974834a63e40 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.167376 Jul 11 21:08:27.298217 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 495/998] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:27 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:27.936726 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b63932e1-b332-41ad-9994-4d8fb24cf6a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:27.937475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b63932e1-b332-41ad-9994-4d8fb24cf6a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:27.946105 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b63932e1-b332-41ad-9994-4d8fb24cf6a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:27.946647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b63932e1-b332-41ad-9994-4d8fb24cf6a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:27.947839 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b63932e1-b332-41ad-9994-4d8fb24cf6a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:27.948443 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b63932e1-b332-41ad-9994-4d8fb24cf6a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:28.088764 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b63932e1-b332-41ad-9994-4d8fb24cf6a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:28.096648 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b63932e1-b332-41ad-9994-4d8fb24cf6a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.164971 Jul 11 21:08:28.097177 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 504/999] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:27 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:28.246009 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:28.246500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:28.254249 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:28.254689 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:28.255507 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:28.255936 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:28.270137 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] HTTP exception thrown: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Request method failure captured: Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: DELETE /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c HTTP/1.1 Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI6-_4zfdvQN9fJEMl4UEvMWtB8x8f-2irLg7Rz3SIuKsnm0VDrz9Xg79CBJpB5ePJeIElcdQc1aaw-qIcTbtRftjY1QHVke1UVVoO766ShN4f4NAudN6yZOV8NJjVY0_w-Zvf_r6nLndKryWVjhzNiGeZSsFHQigf58He62TYU3V7E Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:08:28.271919 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_367a52be93e24b5eaf528a48342d47b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 0965444614ae486e80e111f4126b52f1 Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.273617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '88d87067-da01-484a-86ca-e2ec49f5f15c'} Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:08:28.274520 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.276003 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.277508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Returning 404 to user: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:08:28.277508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1dc17035-513c-43cc-b35e-583c3a2433e2 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 404 len: 111 microversion: 2.1 time: 0.031256 Jul 11 21:08:28.277508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 496/1000] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:08:28 2022] DELETE /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:28.281972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:28.282646 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] [instance: 88d87067-da01-484a-86ca-e2ec49f5f15c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:28.289225 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:28.289621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:28.290417 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:28.290876 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:28.305029 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] HTTP exception thrown: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Request method failure captured: Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c HTTP/1.1 Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI6-_4zfdvQN9fJEMl4UEvMWtB8x8f-2irLg7Rz3SIuKsnm0VDrz9Xg79CBJpB5ePJeIElcdQc1aaw-qIcTbtRftjY1QHVke1UVVoO766ShN4f4NAudN6yZOV8NJjVY0_w-Zvf_r6nLndKryWVjhzNiGeZSsFHQigf58He62TYU3V7E Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:08:28.306567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/367a52be93e24b5eaf528a48342d47b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_367a52be93e24b5eaf528a48342d47b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 367a52be93e24b5eaf528a48342d47b3 Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1493678725 Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 0965444614ae486e80e111f4126b52f1 Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeTestJSON-1493678725-project Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.308462 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '88d87067-da01-484a-86ca-e2ec49f5f15c'} Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:08:28.309842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. Jul 11 21:08:28.311561 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:08:28.313232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] Returning 404 to user: Instance 88d87067-da01-484a-86ca-e2ec49f5f15c could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:08:28.313232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-031107f8-6adc-41de-b25e-54661db16e67 tempest-AttachVolumeTestJSON-1493678725 tempest-AttachVolumeTestJSON-1493678725-project] 10.222.0.20 "GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c" status: 404 len: 111 microversion: 2.1 time: 0.029914 Jul 11 21:08:28.313232 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 505/1001] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:28 2022] GET /compute/v2.1/servers/88d87067-da01-484a-86ca-e2ec49f5f15c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:28.314960 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b84c166d-8d4a-48c8-90cf-12cd6685e05f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:28.315595 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-b84c166d-8d4a-48c8-90cf-12cd6685e05f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:28.321931 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b84c166d-8d4a-48c8-90cf-12cd6685e05f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:28.322404 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b84c166d-8d4a-48c8-90cf-12cd6685e05f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:28.323189 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b84c166d-8d4a-48c8-90cf-12cd6685e05f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:28.323606 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b84c166d-8d4a-48c8-90cf-12cd6685e05f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:28.455292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-b84c166d-8d4a-48c8-90cf-12cd6685e05f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:28.463559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b84c166d-8d4a-48c8-90cf-12cd6685e05f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.152644 Jul 11 21:08:28.472923 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 497/1002] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:28 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:29.114733 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-14056ded-e4fb-4d12-be1e-6912e492903e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:29.115325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-14056ded-e4fb-4d12-be1e-6912e492903e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:29.122091 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-14056ded-e4fb-4d12-be1e-6912e492903e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:29.122765 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-14056ded-e4fb-4d12-be1e-6912e492903e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:29.123701 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-14056ded-e4fb-4d12-be1e-6912e492903e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:29.124341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-14056ded-e4fb-4d12-be1e-6912e492903e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:29.140409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=100 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:29.315602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-14056ded-e4fb-4d12-be1e-6912e492903e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:29.328201 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-14056ded-e4fb-4d12-be1e-6912e492903e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1367 microversion: 2.1 time: 0.217336 Jul 11 21:08:29.329128 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 506/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:29 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:29.481362 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e13a25cb-d92b-4bfa-8f71-8f5d72947620 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:29.481977 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e13a25cb-d92b-4bfa-8f71-8f5d72947620 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:29.491327 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e13a25cb-d92b-4bfa-8f71-8f5d72947620 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:29.492294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e13a25cb-d92b-4bfa-8f71-8f5d72947620 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:29.493531 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e13a25cb-d92b-4bfa-8f71-8f5d72947620 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:29.494225 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e13a25cb-d92b-4bfa-8f71-8f5d72947620 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:29.631434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e13a25cb-d92b-4bfa-8f71-8f5d72947620 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:29.639128 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e13a25cb-d92b-4bfa-8f71-8f5d72947620 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.162349 Jul 11 21:08:29.639701 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 498/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:29 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:30.348834 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9c0f3316-3a65-4699-8bb3-d28d712e2304 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:30.350682 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9c0f3316-3a65-4699-8bb3-d28d712e2304 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:30.361531 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9c0f3316-3a65-4699-8bb3-d28d712e2304 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:30.362358 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9c0f3316-3a65-4699-8bb3-d28d712e2304 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:30.363752 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9c0f3316-3a65-4699-8bb3-d28d712e2304 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:30.364548 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9c0f3316-3a65-4699-8bb3-d28d712e2304 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:30.573973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9c0f3316-3a65-4699-8bb3-d28d712e2304 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:30.581908 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9c0f3316-3a65-4699-8bb3-d28d712e2304 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1557 microversion: 2.1 time: 0.238845 Jul 11 21:08:30.582556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 507/1005] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:30 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1557 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:30.598554 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-3700dea8-473a-4dc9-ba56-9c2b0a79e8e6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:30.599190 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-3700dea8-473a-4dc9-ba56-9c2b0a79e8e6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:30.607355 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3700dea8-473a-4dc9-ba56-9c2b0a79e8e6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:30.607801 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3700dea8-473a-4dc9-ba56-9c2b0a79e8e6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:30.608616 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3700dea8-473a-4dc9-ba56-9c2b0a79e8e6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:30.609050 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3700dea8-473a-4dc9-ba56-9c2b0a79e8e6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:30.657106 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6f92c935-9e7e-41b4-a4d8-919afd4afc90 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:30.657995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6f92c935-9e7e-41b4-a4d8-919afd4afc90 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:30.665917 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f92c935-9e7e-41b4-a4d8-919afd4afc90 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:30.666538 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f92c935-9e7e-41b4-a4d8-919afd4afc90 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:30.668712 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f92c935-9e7e-41b4-a4d8-919afd4afc90 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:30.668712 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6f92c935-9e7e-41b4-a4d8-919afd4afc90 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:30.693283 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-3700dea8-473a-4dc9-ba56-9c2b0a79e8e6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097650 Jul 11 21:08:30.695184 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 499/1006] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jul 11 21:08:30 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:30.890543 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6f92c935-9e7e-41b4-a4d8-919afd4afc90 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:30.900364 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6f92c935-9e7e-41b4-a4d8-919afd4afc90 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.247311 Jul 11 21:08:30.901056 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 508/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:30 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:31.918120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5994dee8-fc2e-402f-9769-85521e825c38 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:31.918882 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5994dee8-fc2e-402f-9769-85521e825c38 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:31.925910 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5994dee8-fc2e-402f-9769-85521e825c38 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:31.926700 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5994dee8-fc2e-402f-9769-85521e825c38 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:31.928094 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5994dee8-fc2e-402f-9769-85521e825c38 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:31.928631 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5994dee8-fc2e-402f-9769-85521e825c38 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:32.228645 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5994dee8-fc2e-402f-9769-85521e825c38 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:32.236513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5994dee8-fc2e-402f-9769-85521e825c38 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.323172 Jul 11 21:08:32.237093 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 500/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:31 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:32.298840 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-f44df018-fc1b-4a65-8fe1-3e75c655fac0 req-3ab36d54-b042-4b23-8c40-03471555efdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861d2bea-e420-47e3-95f6-6dcfde4e7d88", "tag": "80759534-ed8a-4ac4-99d1-330bda28ad63"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:32.308738 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-f44df018-fc1b-4a65-8fe1-3e75c655fac0 req-3ab36d54-b042-4b23-8c40-03471555efdc service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:32.309262 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-f44df018-fc1b-4a65-8fe1-3e75c655fac0 req-3ab36d54-b042-4b23-8c40-03471555efdc service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:32.318992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:32.322285 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-f44df018-fc1b-4a65-8fe1-3e75c655fac0 req-3ab36d54-b042-4b23-8c40-03471555efdc service nova] Creating event network-changed:80759534-ed8a-4ac4-99d1-330bda28ad63 for instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 on hv-cinder-84902 Jul 11 21:08:32.328272 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-f44df018-fc1b-4a65-8fe1-3e75c655fac0 req-3ab36d54-b042-4b23-8c40-03471555efdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033438 Jul 11 21:08:32.329021 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 509/1009] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:33.258640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-776947f8-2ec0-46e5-a673-203926b67a12 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:33.259954 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-776947f8-2ec0-46e5-a673-203926b67a12 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:33.267031 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:33.273725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-776947f8-2ec0-46e5-a673-203926b67a12 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:33.274809 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-776947f8-2ec0-46e5-a673-203926b67a12 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:33.276028 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-776947f8-2ec0-46e5-a673-203926b67a12 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:33.276757 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-776947f8-2ec0-46e5-a673-203926b67a12 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:33.445508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-776947f8-2ec0-46e5-a673-203926b67a12 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:33.455893 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-776947f8-2ec0-46e5-a673-203926b67a12 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.201887 Jul 11 21:08:33.456506 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 501/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:33 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:34.472255 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=6 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:34.478106 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0f013eb4-93c2-4afb-9ccc-b302ab1ded08 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:34.479140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0f013eb4-93c2-4afb-9ccc-b302ab1ded08 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:34.486500 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0f013eb4-93c2-4afb-9ccc-b302ab1ded08 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:34.487214 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0f013eb4-93c2-4afb-9ccc-b302ab1ded08 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:34.488238 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0f013eb4-93c2-4afb-9ccc-b302ab1ded08 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:34.488819 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0f013eb4-93c2-4afb-9ccc-b302ab1ded08 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:34.642073 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0f013eb4-93c2-4afb-9ccc-b302ab1ded08 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:34.650573 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0f013eb4-93c2-4afb-9ccc-b302ab1ded08 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.179156 Jul 11 21:08:34.651325 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 510/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:34 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:35.667515 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5b631293-6fc0-480c-943d-d33fca0d759d tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:35.669057 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5b631293-6fc0-480c-943d-d33fca0d759d tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:35.676896 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b631293-6fc0-480c-943d-d33fca0d759d tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:35.677709 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b631293-6fc0-480c-943d-d33fca0d759d tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:35.678652 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b631293-6fc0-480c-943d-d33fca0d759d tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:35.679211 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b631293-6fc0-480c-943d-d33fca0d759d tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:35.905576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5b631293-6fc0-480c-943d-d33fca0d759d tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:35.914127 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5b631293-6fc0-480c-943d-d33fca0d759d tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.251052 Jul 11 21:08:35.914765 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 502/1012] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:35 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:08:36.935267 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5bec1000-99f5-41e0-bd94-2cee96200c32 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:36.935959 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5bec1000-99f5-41e0-bd94-2cee96200c32 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:36.942433 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5bec1000-99f5-41e0-bd94-2cee96200c32 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:36.942997 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5bec1000-99f5-41e0-bd94-2cee96200c32 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:36.943756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5bec1000-99f5-41e0-bd94-2cee96200c32 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:36.944233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5bec1000-99f5-41e0-bd94-2cee96200c32 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:37.094253 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-5bec1000-99f5-41e0-bd94-2cee96200c32 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:37.102178 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5bec1000-99f5-41e0-bd94-2cee96200c32 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.170835 Jul 11 21:08:37.102740 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 511/1013] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:36 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:38.119000 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2d163442-9546-47eb-866f-ce6c89c9561b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:38.119784 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2d163442-9546-47eb-866f-ce6c89c9561b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:38.131916 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2d163442-9546-47eb-866f-ce6c89c9561b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:38.132397 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2d163442-9546-47eb-866f-ce6c89c9561b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:38.133163 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2d163442-9546-47eb-866f-ce6c89c9561b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:38.133625 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2d163442-9546-47eb-866f-ce6c89c9561b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:38.289630 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2d163442-9546-47eb-866f-ce6c89c9561b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:38.297923 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2d163442-9546-47eb-866f-ce6c89c9561b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.182899 Jul 11 21:08:38.298530 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 503/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:38 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:38.824058 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-c34bca8a-963d-4f8c-b695-dbc1fe14551b req-beea38f9-c5f5-4f5f-b1cd-c952589d6579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bea7e51-186a-4c52-a94a-9470dc903c21", "name": "network-vif-plugged", "status": "completed", "tag": "e0b24542-e2ec-4ba9-8dad-b15749bd5e76"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:38.832912 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-c34bca8a-963d-4f8c-b695-dbc1fe14551b req-beea38f9-c5f5-4f5f-b1cd-c952589d6579 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:38.833388 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-c34bca8a-963d-4f8c-b695-dbc1fe14551b req-beea38f9-c5f5-4f5f-b1cd-c952589d6579 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:38.845960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-c34bca8a-963d-4f8c-b695-dbc1fe14551b req-beea38f9-c5f5-4f5f-b1cd-c952589d6579 service nova] Creating event network-vif-plugged:e0b24542-e2ec-4ba9-8dad-b15749bd5e76 for instance 4bea7e51-186a-4c52-a94a-9470dc903c21 on hv-cinder-84902 Jul 11 21:08:38.851172 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-c34bca8a-963d-4f8c-b695-dbc1fe14551b req-beea38f9-c5f5-4f5f-b1cd-c952589d6579 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031958 Jul 11 21:08:38.852791 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 512/1015] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:39.319108 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-3bdf790a-9baf-466a-81b2-3773238d3b1e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:39.320328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-3bdf790a-9baf-466a-81b2-3773238d3b1e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:39.327455 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3bdf790a-9baf-466a-81b2-3773238d3b1e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:39.327912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3bdf790a-9baf-466a-81b2-3773238d3b1e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:39.328710 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3bdf790a-9baf-466a-81b2-3773238d3b1e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:39.329147 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-3bdf790a-9baf-466a-81b2-3773238d3b1e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:39.469150 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-3bdf790a-9baf-466a-81b2-3773238d3b1e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:39.476910 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-3bdf790a-9baf-466a-81b2-3773238d3b1e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.164535 Jul 11 21:08:39.477467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 504/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:39 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:40.495721 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-834d9580-ae1d-4d3c-af17-a5a6a2a29f52 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:40.496562 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-834d9580-ae1d-4d3c-af17-a5a6a2a29f52 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:40.503821 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-834d9580-ae1d-4d3c-af17-a5a6a2a29f52 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:40.504298 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-834d9580-ae1d-4d3c-af17-a5a6a2a29f52 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:40.505103 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-834d9580-ae1d-4d3c-af17-a5a6a2a29f52 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:40.505626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-834d9580-ae1d-4d3c-af17-a5a6a2a29f52 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:40.648391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-834d9580-ae1d-4d3c-af17-a5a6a2a29f52 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:40.667027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-834d9580-ae1d-4d3c-af17-a5a6a2a29f52 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1261 microversion: 2.1 time: 0.175467 Jul 11 21:08:40.668095 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 513/1017] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:40 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:41.685428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f2bf4f1e-78b8-4fe3-a1b8-5b5fbc492796 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:41.686760 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f2bf4f1e-78b8-4fe3-a1b8-5b5fbc492796 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:41.693625 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2bf4f1e-78b8-4fe3-a1b8-5b5fbc492796 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:41.694065 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2bf4f1e-78b8-4fe3-a1b8-5b5fbc492796 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:41.694823 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2bf4f1e-78b8-4fe3-a1b8-5b5fbc492796 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:41.695255 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f2bf4f1e-78b8-4fe3-a1b8-5b5fbc492796 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:41.829292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f2bf4f1e-78b8-4fe3-a1b8-5b5fbc492796 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:41.837874 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f2bf4f1e-78b8-4fe3-a1b8-5b5fbc492796 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1445 microversion: 2.1 time: 0.156564 Jul 11 21:08:41.839151 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 505/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:41 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:08:41.855468 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-fcaec169-27d7-4f02-9fb1-d041433924d5 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:41.856153 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-fcaec169-27d7-4f02-9fb1-d041433924d5 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:41.862697 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fcaec169-27d7-4f02-9fb1-d041433924d5 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:41.863140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fcaec169-27d7-4f02-9fb1-d041433924d5 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:41.863905 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fcaec169-27d7-4f02-9fb1-d041433924d5 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:41.864359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-fcaec169-27d7-4f02-9fb1-d041433924d5 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:42.002423 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-fcaec169-27d7-4f02-9fb1-d041433924d5 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:42.010078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-fcaec169-27d7-4f02-9fb1-d041433924d5 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1445 microversion: 2.1 time: 0.159341 Jul 11 21:08:42.010727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 514/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:08:41 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:43.967055 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-f3d61013-5894-4d42-9868-8a1916a0a133 req-0d6b6861-b8ab-49fa-9a28-595e95a47f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bea7e51-186a-4c52-a94a-9470dc903c21", "tag": "e0b24542-e2ec-4ba9-8dad-b15749bd5e76"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:43.976794 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-f3d61013-5894-4d42-9868-8a1916a0a133 req-0d6b6861-b8ab-49fa-9a28-595e95a47f1a service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:43.977416 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-f3d61013-5894-4d42-9868-8a1916a0a133 req-0d6b6861-b8ab-49fa-9a28-595e95a47f1a service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:43.990652 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-f3d61013-5894-4d42-9868-8a1916a0a133 req-0d6b6861-b8ab-49fa-9a28-595e95a47f1a service nova] Creating event network-changed:e0b24542-e2ec-4ba9-8dad-b15749bd5e76 for instance 4bea7e51-186a-4c52-a94a-9470dc903c21 on hv-cinder-84902 Jul 11 21:08:44.031066 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-f3d61013-5894-4d42-9868-8a1916a0a133 req-0d6b6861-b8ab-49fa-9a28-595e95a47f1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068507 Jul 11 21:08:44.036750 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 506/1020] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:54.692332 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-02484aa9-f953-4149-9300-4135542e4821 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:54.693257 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-02484aa9-f953-4149-9300-4135542e4821 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:54.695621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:54.696491 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=43 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:54.704191 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-02484aa9-f953-4149-9300-4135542e4821 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:54.704646 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-02484aa9-f953-4149-9300-4135542e4821 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:54.705370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-02484aa9-f953-4149-9300-4135542e4821 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:54.705805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-02484aa9-f953-4149-9300-4135542e4821 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:54.738073 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-02484aa9-f953-4149-9300-4135542e4821 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050115 Jul 11 21:08:54.738674 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 515/1021] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jul 11 21:08:54 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:08:54.802802 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=45 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:54.803543 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=57 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:54.807637 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c7e27de0-5a19-4701-a4d2-3219d44603b3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:54.808227 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c7e27de0-5a19-4701-a4d2-3219d44603b3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:54.815431 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c7e27de0-5a19-4701-a4d2-3219d44603b3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:54.815890 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c7e27de0-5a19-4701-a4d2-3219d44603b3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:54.816680 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c7e27de0-5a19-4701-a4d2-3219d44603b3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:54.817213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c7e27de0-5a19-4701-a4d2-3219d44603b3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:54.847144 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c7e27de0-5a19-4701-a4d2-3219d44603b3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:08:54.930320 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c7e27de0-5a19-4701-a4d2-3219d44603b3 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "DELETE /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 204 len: 0 microversion: 2.20 time: 0.128986 Jul 11 21:08:54.931192 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 507/1022] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jul 11 21:08:54 2022] DELETE /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 21:08:54.939560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:54.940246 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:54.947169 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:54.947624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:54.948426 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:54.948835 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:55.086924 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:55.095481 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:55.097018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:55.098249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-80ce765c-512f-47af-933f-e21ef4453b93 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.162653 Jul 11 21:08:55.098797 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 516/1023] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:08:54 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 21:08:56.118168 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:56.119100 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:56.126176 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:56.127953 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:56.129072 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:56.129594 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:56.271934 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:56.280147 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:56.281620 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:56.282888 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-16806d6c-8575-498f-94bd-6c6aa126ad5a tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.169341 Jul 11 21:08:56.283478 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 508/1024] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:08:56 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:08:57.302775 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:57.303354 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:57.310919 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:57.311616 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:57.312592 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:57.313205 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:57.452964 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:57.461727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:57.463203 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:57.464658 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e7f71d78-c0fa-410e-a109-36cef8e66406 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1722 microversion: 2.20 time: 0.165832 Jul 11 21:08:57.465293 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 517/1025] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:08:57 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:08:58.124187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-d110c477-c8e2-49cf-a6bd-f7c182fe8f51 req-349acae0-fad3-42a3-ae6c-43ec2d2414ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169a98b1-4200-4917-86bd-62e3581530f0", "name": "network-vif-deleted", "tag": "744bb15f-623b-4153-b111-d80b7f202ffc"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:08:58.134070 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-d110c477-c8e2-49cf-a6bd-f7c182fe8f51 req-349acae0-fad3-42a3-ae6c-43ec2d2414ca service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:58.134819 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-d110c477-c8e2-49cf-a6bd-f7c182fe8f51 req-349acae0-fad3-42a3-ae6c-43ec2d2414ca service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:58.148158 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-d110c477-c8e2-49cf-a6bd-f7c182fe8f51 req-349acae0-fad3-42a3-ae6c-43ec2d2414ca service nova] Creating event network-vif-deleted:744bb15f-623b-4153-b111-d80b7f202ffc for instance 169a98b1-4200-4917-86bd-62e3581530f0 on hv-cinder-84902 Jul 11 21:08:58.159123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-d110c477-c8e2-49cf-a6bd-f7c182fe8f51 req-349acae0-fad3-42a3-ae6c-43ec2d2414ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196554 Jul 11 21:08:58.160099 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 509/1026] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:08:58.483715 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:58.484945 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:58.492753 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:58.493502 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:58.494486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:58.495128 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:58.535413 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:58.535860 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:58.536375 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lazy-loading 'fault' on Instance uuid 169a98b1-4200-4917-86bd-62e3581530f0 {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:08:58.581171 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:58.590146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:58.591912 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77cf43c378a9413dbd799a00bfa21eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570d2b4d5c384612ba17efc8b5bd02ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:08:58.593307 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6402fb84-ae41-4535-94a6-dbab557d6a46 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 200 len: 1370 microversion: 2.20 time: 0.114011 Jul 11 21:08:58.593854 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 518/1027] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:08:58 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 21:08:59.612294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:59.612992 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:08:59.619776 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:59.620337 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:59.621100 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:08:59.621529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:08:59.637031 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] HTTP exception thrown: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Request method failure captured: Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 HTTP/1.1 Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI7At3eRhknGlYUgt2zeR7wpPiedO64GVhCUwQISFTc_fzwsgUrTG8aU4Rn0T9K01xqY8v1da4tQMb2W2SBRjf6RzLip1CbYemNCCCrCDwqLEYGVgYoVX_FxZf0GBFDU_soFBKg6mPqD2PYo6nJ-datOvTmebHqxK1kVo-eQcxb2UoY Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:08:59.638719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_570d2b4d5c384612ba17efc8b5bd02ec", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 77cf43c378a9413dbd799a00bfa21eb8 Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:08:59.640269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '169a98b1-4200-4917-86bd-62e3581530f0'} Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:08:59.641235 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:08:59.642894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:08:59.644089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Returning 404 to user: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:08:59.644089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d8fd359e-d144-41bf-aee0-5885cd0e16f2 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 404 len: 111 microversion: 2.20 time: 0.032785 Jul 11 21:08:59.644089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 510/1028] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:08:59 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 21:08:59.651079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2fcd45d6-df36-4f0d-bcf8-e47c6f3c33ba tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '.version_select at 0x7f384038a1f0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:08:59.683806 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2fcd45d6-df36-4f0d-bcf8-e47c6f3c33ba tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523406216" status: 204 len: 0 microversion: 2.20 time: 0.036269 Jul 11 21:08:59.684775 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 519/1029] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Jul 11 21:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523406216 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 21:09:01.529042 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:01.529513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:01.536589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:01.537018 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:01.537775 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:01.538199 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:01.552832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] HTTP exception thrown: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Request method failure captured: Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: DELETE /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 HTTP/1.1 Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI7At3eRhknGlYUgt2zeR7wpPiedO64GVhCUwQISFTc_fzwsgUrTG8aU4Rn0T9K01xqY8v1da4tQMb2W2SBRjf6RzLip1CbYemNCCCrCDwqLEYGVgYoVX_FxZf0GBFDU_soFBKg6mPqD2PYo6nJ-datOvTmebHqxK1kVo-eQcxb2UoY Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:09:01.554387 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_570d2b4d5c384612ba17efc8b5bd02ec", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 77cf43c378a9413dbd799a00bfa21eb8 Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.555966 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '169a98b1-4200-4917-86bd-62e3581530f0'} Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:09:01.556798 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.558071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.559329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Returning 404 to user: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:09:01.559329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7756fdb6-f9cb-4685-88b9-9b5231b55f71 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "DELETE /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 404 len: 111 microversion: 2.20 time: 0.031175 Jul 11 21:09:01.559329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 511/1030] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jul 11 21:09:01 2022] DELETE /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 21:09:01.564785 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:01.565439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 169a98b1-4200-4917-86bd-62e3581530f0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:01.572620 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:01.573061 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:01.573815 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:01.574242 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:01.588283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] HTTP exception thrown: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Request method failure captured: Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 HTTP/1.1 Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI7At3eRhknGlYUgt2zeR7wpPiedO64GVhCUwQISFTc_fzwsgUrTG8aU4Rn0T9K01xqY8v1da4tQMb2W2SBRjf6RzLip1CbYemNCCCrCDwqLEYGVgYoVX_FxZf0GBFDU_soFBKg6mPqD2PYo6nJ-datOvTmebHqxK1kVo-eQcxb2UoY Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:09:01.589929 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_570d2b4d5c384612ba17efc8b5bd02ec", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 77cf43c378a9413dbd799a00bfa21eb8 Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.591843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '169a98b1-4200-4917-86bd-62e3581530f0'} Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:09:01.592991 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. Jul 11 21:09:01.595019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:01.596683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Returning 404 to user: Instance 169a98b1-4200-4917-86bd-62e3581530f0 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:09:01.596683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-af8debde-569d-4302-8b33-368bfa336b5f tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0" status: 404 len: 111 microversion: 2.20 time: 0.030379 Jul 11 21:09:01.596683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 520/1031] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:09:01 2022] GET /compute/v2.1/servers/169a98b1-4200-4917-86bd-62e3581530f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 21:09:02.731645 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:02.732183 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:02.738381 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:02.738831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:02.739600 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:02.740028 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:02.754912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] HTTP exception thrown: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Request method failure captured: Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: DELETE /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 HTTP/1.1 Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI7At3eRhknGlYUgt2zeR7wpPiedO64GVhCUwQISFTc_fzwsgUrTG8aU4Rn0T9K01xqY8v1da4tQMb2W2SBRjf6RzLip1CbYemNCCCrCDwqLEYGVgYoVX_FxZf0GBFDU_soFBKg6mPqD2PYo6nJ-datOvTmebHqxK1kVo-eQcxb2UoY Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:09:02.756576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_570d2b4d5c384612ba17efc8b5bd02ec", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 77cf43c378a9413dbd799a00bfa21eb8 Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.758382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '1536f24e-dc7b-4eaf-9b73-32205dbca872'} Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:09:02.759331 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.760912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.762390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Returning 404 to user: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:09:02.762390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2a6f3d6d-5d30-4929-b54d-092ce55de8c5 tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 404 len: 111 microversion: 2.20 time: 0.030402 Jul 11 21:09:02.762390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 512/1032] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jul 11 21:09:02 2022] DELETE /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 21:09:02.766727 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:02.767319 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] [instance: 1536f24e-dc7b-4eaf-9b73-32205dbca872] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:02.774012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:02.774459 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:02.775216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:02.775646 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:02.789218 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] HTTP exception thrown: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Request method failure captured: Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 HTTP/1.1 Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI7At3eRhknGlYUgt2zeR7wpPiedO64GVhCUwQISFTc_fzwsgUrTG8aU4Rn0T9K01xqY8v1da4tQMb2W2SBRjf6RzLip1CbYemNCCCrCDwqLEYGVgYoVX_FxZf0GBFDU_soFBKg6mPqD2PYo6nJ-datOvTmebHqxK1kVo-eQcxb2UoY Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:09:02.790784 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/570d2b4d5c384612ba17efc8b5bd02ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_570d2b4d5c384612ba17efc8b5bd02ec", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 570d2b4d5c384612ba17efc8b5bd02ec Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2048055625 Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 77cf43c378a9413dbd799a00bfa21eb8 Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2048055625-project Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.792373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '1536f24e-dc7b-4eaf-9b73-32205dbca872'} Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:09:02.793233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. Jul 11 21:09:02.794602 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:02.795941 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] Returning 404 to user: Instance 1536f24e-dc7b-4eaf-9b73-32205dbca872 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:09:02.795941 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2ad3b073-efd4-4433-ad8e-2bc58713a0ff tempest-AttachVolumeShelveTestJSON-2048055625 tempest-AttachVolumeShelveTestJSON-2048055625-project] 10.222.0.20 "GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872" status: 404 len: 111 microversion: 2.20 time: 0.029329 Jul 11 21:09:02.795941 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 521/1033] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jul 11 21:09:02 2022] GET /compute/v2.1/servers/1536f24e-dc7b-4eaf-9b73-32205dbca872 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 21:09:04.095461 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1543178318", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:09:04.146284 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] validate_networks() for None {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:09:04.818377 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:09:04.818833 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:09:04.819303 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:09:04.819711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:09:04.820258 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:09:04.829740 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:04.830338 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:04.831163 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:04.831589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:04.851173 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Getting quotas for project 3539cabdbfa943a49368f866270a776b. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:09:04.855384 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Getting quotas for user fe0be3efded64c04ad05b984b52c534f and project 3539cabdbfa943a49368f866270a776b. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:09:04.868002 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:09:04.870321 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:09:04.925715 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-88a39a6f-5429-41f8-952f-85619cd76c7a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833842 Jul 11 21:09:04.927953 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 513/1034] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:09:04.937396 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c2820dfd-989a-49d5-9f47-c4a3ba409164 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:04.938197 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c2820dfd-989a-49d5-9f47-c4a3ba409164 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:05.048435 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-c2820dfd-989a-49d5-9f47-c4a3ba409164 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:05.056805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c2820dfd-989a-49d5-9f47-c4a3ba409164 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1215 microversion: 2.1 time: 0.123475 Jul 11 21:09:05.058042 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 522/1035] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:04 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:09:06.079531 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ef4cc2bf-8fbc-4085-8fa4-6923e1cd1a6a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:06.080172 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ef4cc2bf-8fbc-4085-8fa4-6923e1cd1a6a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:06.088825 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef4cc2bf-8fbc-4085-8fa4-6923e1cd1a6a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:06.089465 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef4cc2bf-8fbc-4085-8fa4-6923e1cd1a6a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:06.091237 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef4cc2bf-8fbc-4085-8fa4-6923e1cd1a6a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:06.091891 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef4cc2bf-8fbc-4085-8fa4-6923e1cd1a6a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:06.207151 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ef4cc2bf-8fbc-4085-8fa4-6923e1cd1a6a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:06.217079 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ef4cc2bf-8fbc-4085-8fa4-6923e1cd1a6a tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1267 microversion: 2.1 time: 0.144156 Jul 11 21:09:06.218369 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 514/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:06 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:07.235013 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-07042a2f-79c1-451c-8a8d-f0f4119fe228 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:07.236303 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-07042a2f-79c1-451c-8a8d-f0f4119fe228 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:07.244401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07042a2f-79c1-451c-8a8d-f0f4119fe228 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:07.245124 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07042a2f-79c1-451c-8a8d-f0f4119fe228 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:07.245907 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07042a2f-79c1-451c-8a8d-f0f4119fe228 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:07.246321 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07042a2f-79c1-451c-8a8d-f0f4119fe228 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:07.412495 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-07042a2f-79c1-451c-8a8d-f0f4119fe228 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:07.424271 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-07042a2f-79c1-451c-8a8d-f0f4119fe228 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.193403 Jul 11 21:09:07.425287 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 523/1037] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:07 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:08.131449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-cd5931e4-d69d-4a0c-bdbb-fecffb8f4cbf req-2d0bdd60-5b36-40ed-81a6-22afa0658489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901f8dc1-4c47-48e0-ba54-48027313cf3d", "tag": "3a5051ad-0c22-448e-a28c-44f65153bda3"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:09:08.153305 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-cd5931e4-d69d-4a0c-bdbb-fecffb8f4cbf req-2d0bdd60-5b36-40ed-81a6-22afa0658489 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:08.153746 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-cd5931e4-d69d-4a0c-bdbb-fecffb8f4cbf req-2d0bdd60-5b36-40ed-81a6-22afa0658489 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:08.169352 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-cd5931e4-d69d-4a0c-bdbb-fecffb8f4cbf req-2d0bdd60-5b36-40ed-81a6-22afa0658489 service nova] Creating event network-changed:3a5051ad-0c22-448e-a28c-44f65153bda3 for instance 901f8dc1-4c47-48e0-ba54-48027313cf3d on hv-cinder-84902 Jul 11 21:09:08.178267 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-cd5931e4-d69d-4a0c-bdbb-fecffb8f4cbf req-2d0bdd60-5b36-40ed-81a6-22afa0658489 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062925 Jul 11 21:09:08.182517 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 515/1038] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:09:08.441995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2b505f53-b8fa-4e56-bc85-c7424bc33215 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:08.443314 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2b505f53-b8fa-4e56-bc85-c7424bc33215 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:08.450482 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b505f53-b8fa-4e56-bc85-c7424bc33215 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:08.451290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b505f53-b8fa-4e56-bc85-c7424bc33215 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:08.452500 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b505f53-b8fa-4e56-bc85-c7424bc33215 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:08.453191 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b505f53-b8fa-4e56-bc85-c7424bc33215 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:08.920633 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2b505f53-b8fa-4e56-bc85-c7424bc33215 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:08.930207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2b505f53-b8fa-4e56-bc85-c7424bc33215 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.492476 Jul 11 21:09:08.930848 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 524/1039] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:08 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:09.947857 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-88751caf-7438-4003-a49b-2176d01cced5 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:09.950224 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-88751caf-7438-4003-a49b-2176d01cced5 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:09.957761 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-88751caf-7438-4003-a49b-2176d01cced5 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:09.958105 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-88751caf-7438-4003-a49b-2176d01cced5 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:09.958870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-88751caf-7438-4003-a49b-2176d01cced5 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:09.959298 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-88751caf-7438-4003-a49b-2176d01cced5 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:10.174079 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-88751caf-7438-4003-a49b-2176d01cced5 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:10.182556 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-88751caf-7438-4003-a49b-2176d01cced5 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.239046 Jul 11 21:09:10.183126 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 516/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:09 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:11.199115 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-304f6eb0-1a44-4fed-96a1-918401cf7362 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:11.199722 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-304f6eb0-1a44-4fed-96a1-918401cf7362 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:11.206599 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-304f6eb0-1a44-4fed-96a1-918401cf7362 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:11.207433 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-304f6eb0-1a44-4fed-96a1-918401cf7362 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:11.208261 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-304f6eb0-1a44-4fed-96a1-918401cf7362 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:11.208700 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-304f6eb0-1a44-4fed-96a1-918401cf7362 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:11.433219 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-304f6eb0-1a44-4fed-96a1-918401cf7362 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:11.441613 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-304f6eb0-1a44-4fed-96a1-918401cf7362 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.246350 Jul 11 21:09:11.442208 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 525/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:11 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:12.458929 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-944532e8-8990-4e6c-b2fc-d4360719c971 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:12.459530 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-944532e8-8990-4e6c-b2fc-d4360719c971 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:12.466094 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-944532e8-8990-4e6c-b2fc-d4360719c971 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:12.466549 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-944532e8-8990-4e6c-b2fc-d4360719c971 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:12.467302 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-944532e8-8990-4e6c-b2fc-d4360719c971 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:12.467731 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-944532e8-8990-4e6c-b2fc-d4360719c971 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:12.610429 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-944532e8-8990-4e6c-b2fc-d4360719c971 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:12.619388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-944532e8-8990-4e6c-b2fc-d4360719c971 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.164444 Jul 11 21:09:12.619973 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 517/1042] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:12 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:13.637689 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-32ffe6ef-36c3-4af4-afcd-71b3509b5ece tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:13.638880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-32ffe6ef-36c3-4af4-afcd-71b3509b5ece tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:13.645816 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-32ffe6ef-36c3-4af4-afcd-71b3509b5ece tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:13.646364 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-32ffe6ef-36c3-4af4-afcd-71b3509b5ece tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:13.647210 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-32ffe6ef-36c3-4af4-afcd-71b3509b5ece tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:13.648078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-32ffe6ef-36c3-4af4-afcd-71b3509b5ece tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:13.783473 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-32ffe6ef-36c3-4af4-afcd-71b3509b5ece tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:13.791099 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-32ffe6ef-36c3-4af4-afcd-71b3509b5ece tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.157965 Jul 11 21:09:13.791691 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 526/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:13 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:14.812725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ad524a0a-081c-46c5-8803-72a4309836cd tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:14.813726 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ad524a0a-081c-46c5-8803-72a4309836cd tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:14.821875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad524a0a-081c-46c5-8803-72a4309836cd tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:14.822324 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad524a0a-081c-46c5-8803-72a4309836cd tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:14.823111 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad524a0a-081c-46c5-8803-72a4309836cd tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:14.823575 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ad524a0a-081c-46c5-8803-72a4309836cd tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:14.843159 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:14.863106 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:14.959398 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ad524a0a-081c-46c5-8803-72a4309836cd tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:14.967004 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ad524a0a-081c-46c5-8803-72a4309836cd tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.160892 Jul 11 21:09:14.967581 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 518/1044] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:14 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:15.056661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:15.097377 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-adfe0989-f73e-424b-9bc8-f02d7f11ad60 req-d7b6ff50-67d0-4496-86cb-5d69da21cf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901f8dc1-4c47-48e0-ba54-48027313cf3d", "name": "network-vif-plugged", "status": "completed", "tag": "3a5051ad-0c22-448e-a28c-44f65153bda3"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:09:15.106136 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-adfe0989-f73e-424b-9bc8-f02d7f11ad60 req-d7b6ff50-67d0-4496-86cb-5d69da21cf94 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:15.106584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-adfe0989-f73e-424b-9bc8-f02d7f11ad60 req-d7b6ff50-67d0-4496-86cb-5d69da21cf94 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:15.117854 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-adfe0989-f73e-424b-9bc8-f02d7f11ad60 req-d7b6ff50-67d0-4496-86cb-5d69da21cf94 service nova] Creating event network-vif-plugged:3a5051ad-0c22-448e-a28c-44f65153bda3 for instance 901f8dc1-4c47-48e0-ba54-48027313cf3d on hv-cinder-84902 Jul 11 21:09:15.122851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-adfe0989-f73e-424b-9bc8-f02d7f11ad60 req-d7b6ff50-67d0-4496-86cb-5d69da21cf94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157228 Jul 11 21:09:15.123452 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 527/1045] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 21:09:15.988143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5532b4c1-806e-44f3-85b9-833a98fcda85 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:15.989008 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5532b4c1-806e-44f3-85b9-833a98fcda85 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:15.997631 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5532b4c1-806e-44f3-85b9-833a98fcda85 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:15.998162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5532b4c1-806e-44f3-85b9-833a98fcda85 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:15.999354 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5532b4c1-806e-44f3-85b9-833a98fcda85 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:15.999920 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5532b4c1-806e-44f3-85b9-833a98fcda85 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:16.133855 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5532b4c1-806e-44f3-85b9-833a98fcda85 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:16.145074 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5532b4c1-806e-44f3-85b9-833a98fcda85 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.163331 Jul 11 21:09:16.145994 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 519/1046] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:15 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:17.173583 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2f3a2563-5394-439f-a709-25e8bf1d3167 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:17.174729 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2f3a2563-5394-439f-a709-25e8bf1d3167 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:17.182032 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f3a2563-5394-439f-a709-25e8bf1d3167 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:17.182479 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f3a2563-5394-439f-a709-25e8bf1d3167 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:17.183252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f3a2563-5394-439f-a709-25e8bf1d3167 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:17.183682 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f3a2563-5394-439f-a709-25e8bf1d3167 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:17.328140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2f3a2563-5394-439f-a709-25e8bf1d3167 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:17.335686 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2f3a2563-5394-439f-a709-25e8bf1d3167 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.170362 Jul 11 21:09:17.336273 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 528/1047] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:17 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:18.356719 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2691453f-08a8-49c7-aac7-3f15da3778c4 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:18.357731 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2691453f-08a8-49c7-aac7-3f15da3778c4 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:18.369197 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2691453f-08a8-49c7-aac7-3f15da3778c4 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:18.369936 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2691453f-08a8-49c7-aac7-3f15da3778c4 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:18.371191 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2691453f-08a8-49c7-aac7-3f15da3778c4 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:18.371903 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2691453f-08a8-49c7-aac7-3f15da3778c4 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:18.510310 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2691453f-08a8-49c7-aac7-3f15da3778c4 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:18.518442 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2691453f-08a8-49c7-aac7-3f15da3778c4 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.168337 Jul 11 21:09:18.519014 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 520/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:18 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:19.540498 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0a4e0bdb-8f94-40f3-81c8-c4049fa1fa9d tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:19.541522 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0a4e0bdb-8f94-40f3-81c8-c4049fa1fa9d tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:19.553152 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0a4e0bdb-8f94-40f3-81c8-c4049fa1fa9d tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:19.553744 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0a4e0bdb-8f94-40f3-81c8-c4049fa1fa9d tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:19.554558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0a4e0bdb-8f94-40f3-81c8-c4049fa1fa9d tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:19.555138 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0a4e0bdb-8f94-40f3-81c8-c4049fa1fa9d tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:19.701409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0a4e0bdb-8f94-40f3-81c8-c4049fa1fa9d tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:19.709258 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0a4e0bdb-8f94-40f3-81c8-c4049fa1fa9d tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.175711 Jul 11 21:09:19.709812 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 529/1049] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:19 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:20.727160 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ffd4678d-827b-4ec5-be2d-cbb1e9e33d7c tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:20.727755 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ffd4678d-827b-4ec5-be2d-cbb1e9e33d7c tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:20.734696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ffd4678d-827b-4ec5-be2d-cbb1e9e33d7c tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:20.735146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ffd4678d-827b-4ec5-be2d-cbb1e9e33d7c tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:20.735905 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ffd4678d-827b-4ec5-be2d-cbb1e9e33d7c tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:20.736374 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ffd4678d-827b-4ec5-be2d-cbb1e9e33d7c tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:20.891266 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ffd4678d-827b-4ec5-be2d-cbb1e9e33d7c tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:20.899149 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ffd4678d-827b-4ec5-be2d-cbb1e9e33d7c tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.176147 Jul 11 21:09:20.899703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 521/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:20 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:21.920528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9ab24438-b42a-45e7-b766-65deded50d94 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:21.921128 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9ab24438-b42a-45e7-b766-65deded50d94 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:21.927901 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9ab24438-b42a-45e7-b766-65deded50d94 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:21.928465 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9ab24438-b42a-45e7-b766-65deded50d94 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:21.929223 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9ab24438-b42a-45e7-b766-65deded50d94 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:21.929656 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9ab24438-b42a-45e7-b766-65deded50d94 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:22.088636 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9ab24438-b42a-45e7-b766-65deded50d94 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:22.096308 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9ab24438-b42a-45e7-b766-65deded50d94 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1315 microversion: 2.1 time: 0.179528 Jul 11 21:09:22.096860 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 530/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:21 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:23.113294 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-376e213e-e082-40ed-9cda-e8c4cfbaaf96 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:23.113887 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-376e213e-e082-40ed-9cda-e8c4cfbaaf96 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:23.121109 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-376e213e-e082-40ed-9cda-e8c4cfbaaf96 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:23.121567 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-376e213e-e082-40ed-9cda-e8c4cfbaaf96 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:23.122335 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-376e213e-e082-40ed-9cda-e8c4cfbaaf96 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:23.122769 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-376e213e-e082-40ed-9cda-e8c4cfbaaf96 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:23.268773 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-376e213e-e082-40ed-9cda-e8c4cfbaaf96 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:23.278374 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-376e213e-e082-40ed-9cda-e8c4cfbaaf96 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1464 microversion: 2.1 time: 0.168973 Jul 11 21:09:23.278957 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 522/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:23 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:23.318676 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3d251866-bb3a-45e7-bb0b-c0e9542b27e6 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:23.319202 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3d251866-bb3a-45e7-bb0b-c0e9542b27e6 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:23.325770 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3d251866-bb3a-45e7-bb0b-c0e9542b27e6 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:23.326216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3d251866-bb3a-45e7-bb0b-c0e9542b27e6 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:23.326973 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3d251866-bb3a-45e7-bb0b-c0e9542b27e6 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:23.327401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3d251866-bb3a-45e7-bb0b-c0e9542b27e6 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:23.352670 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3d251866-bb3a-45e7-bb0b-c0e9542b27e6 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:09:23.452201 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3d251866-bb3a-45e7-bb0b-c0e9542b27e6 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "DELETE /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 204 len: 0 microversion: 2.1 time: 0.137001 Jul 11 21:09:23.452886 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 531/1053] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:09:23 2022] DELETE /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:09:23.461576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c4accdaa-1735-4f44-ace9-9c93a95260cc tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:23.462128 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c4accdaa-1735-4f44-ace9-9c93a95260cc tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:23.468101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c4accdaa-1735-4f44-ace9-9c93a95260cc tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:23.468589 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c4accdaa-1735-4f44-ace9-9c93a95260cc tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:23.469337 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c4accdaa-1735-4f44-ace9-9c93a95260cc tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:23.469764 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c4accdaa-1735-4f44-ace9-9c93a95260cc tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:23.623903 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-c4accdaa-1735-4f44-ace9-9c93a95260cc tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:23.632739 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c4accdaa-1735-4f44-ace9-9c93a95260cc tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1470 microversion: 2.1 time: 0.174917 Jul 11 21:09:23.633434 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 523/1054] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:23 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:09:24.651892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9e720db8-2b13-4c07-bc3a-ff74c53e027b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:24.652655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9e720db8-2b13-4c07-bc3a-ff74c53e027b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:24.660924 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9e720db8-2b13-4c07-bc3a-ff74c53e027b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:24.661447 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9e720db8-2b13-4c07-bc3a-ff74c53e027b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:24.662328 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9e720db8-2b13-4c07-bc3a-ff74c53e027b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:24.662831 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9e720db8-2b13-4c07-bc3a-ff74c53e027b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:24.813496 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-9e720db8-2b13-4c07-bc3a-ff74c53e027b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:24.816129 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:24.824684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9e720db8-2b13-4c07-bc3a-ff74c53e027b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1470 microversion: 2.1 time: 0.178076 Jul 11 21:09:24.825515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 532/1055] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:24 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:25.843206 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-afc44670-4d19-48ba-902a-45fc4c065466 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:25.843807 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-afc44670-4d19-48ba-902a-45fc4c065466 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:25.846398 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:25.852523 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-afc44670-4d19-48ba-902a-45fc4c065466 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:25.852962 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-afc44670-4d19-48ba-902a-45fc4c065466 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:25.853720 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-afc44670-4d19-48ba-902a-45fc4c065466 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:25.854146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-afc44670-4d19-48ba-902a-45fc4c065466 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:25.857424 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:25.988857 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-afc44670-4d19-48ba-902a-45fc4c065466 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:25.997481 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-afc44670-4d19-48ba-902a-45fc4c065466 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1470 microversion: 2.1 time: 0.158216 Jul 11 21:09:25.998051 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 524/1056] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:25 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:27.019324 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-46f29479-f589-4986-bcec-e1ae947cc4d7 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:27.020193 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-46f29479-f589-4986-bcec-e1ae947cc4d7 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:27.024554 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:27.030290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-46f29479-f589-4986-bcec-e1ae947cc4d7 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:27.030730 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-46f29479-f589-4986-bcec-e1ae947cc4d7 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:27.031492 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-46f29479-f589-4986-bcec-e1ae947cc4d7 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:27.031933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-46f29479-f589-4986-bcec-e1ae947cc4d7 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:27.168326 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-46f29479-f589-4986-bcec-e1ae947cc4d7 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:27.179303 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-46f29479-f589-4986-bcec-e1ae947cc4d7 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1470 microversion: 2.1 time: 0.166990 Jul 11 21:09:27.179892 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 533/1057] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:27 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:28.199723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0f88a9e2-1001-451c-9060-615408c0738b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:28.200411 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0f88a9e2-1001-451c-9060-615408c0738b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:28.208032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0f88a9e2-1001-451c-9060-615408c0738b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:28.208557 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0f88a9e2-1001-451c-9060-615408c0738b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:28.209400 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0f88a9e2-1001-451c-9060-615408c0738b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:28.209900 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0f88a9e2-1001-451c-9060-615408c0738b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:28.349153 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0f88a9e2-1001-451c-9060-615408c0738b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:28.357744 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0f88a9e2-1001-451c-9060-615408c0738b tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1470 microversion: 2.1 time: 0.163001 Jul 11 21:09:28.367201 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 525/1058] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:28 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:29.215526 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-38802730-4e18-4329-b986-35525fcd4465 req-5bafe981-ab18-4dbf-8b81-53ca1aa0c7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901f8dc1-4c47-48e0-ba54-48027313cf3d", "name": "network-vif-deleted", "tag": "3a5051ad-0c22-448e-a28c-44f65153bda3"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:09:29.224419 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-38802730-4e18-4329-b986-35525fcd4465 req-5bafe981-ab18-4dbf-8b81-53ca1aa0c7a4 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:29.224858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-38802730-4e18-4329-b986-35525fcd4465 req-5bafe981-ab18-4dbf-8b81-53ca1aa0c7a4 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:29.237035 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-38802730-4e18-4329-b986-35525fcd4465 req-5bafe981-ab18-4dbf-8b81-53ca1aa0c7a4 service nova] Creating event network-vif-deleted:3a5051ad-0c22-448e-a28c-44f65153bda3 for instance 901f8dc1-4c47-48e0-ba54-48027313cf3d on hv-cinder-84902 Jul 11 21:09:29.242064 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-38802730-4e18-4329-b986-35525fcd4465 req-5bafe981-ab18-4dbf-8b81-53ca1aa0c7a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030639 Jul 11 21:09:29.246080 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 534/1059] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:09:29.374958 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:29.375562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:29.382253 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:29.382701 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:29.383657 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:29.384093 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:29.415354 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:29.415711 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:29.416233 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lazy-loading 'fault' on Instance uuid 901f8dc1-4c47-48e0-ba54-48027313cf3d {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:09:29.460302 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0be3efded64c04ad05b984b52c534f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cabdbfa943a49368f866270a776b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:09:29.468015 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-13a717ff-8dd1-431d-b6b1-223200b216b3 tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 200 len: 1305 microversion: 2.1 time: 0.097008 Jul 11 21:09:29.468614 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 526/1060] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:29 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:09:30.491506 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:09:30.492684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] [instance: 901f8dc1-4c47-48e0-ba54-48027313cf3d] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:09:30.500435 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:30.500887 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:30.501626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:09:30.502081 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:09:30.515475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] HTTP exception thrown: Instance 901f8dc1-4c47-48e0-ba54-48027313cf3d could not be found. Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Request method failure captured: Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d HTTP/1.1 Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJFunPdBq1ba6f72hrlR-yKJ1Tk-AibSzxYlv-LPtFNIGvM_SRArDiJL5DP2R_Kk9UV2P-eayPDnuWNx8Bp_7mLamay9w5cTnoP4r0EYoCRStEpwQW8gqWw9XIb0EwAZpJsghW9p60cerMgEABYLvE_w35Yd37Sbgy1Zf7F4LRYKV_E Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 3539cabdbfa943a49368f866270a776b Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesNegativeTest-322309005 Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:09:30.517127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3539cabdbfa943a49368f866270a776b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3539cabdbfa943a49368f866270a776b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3539cabdbfa943a49368f866270a776b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3539cabdbfa943a49368f866270a776b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesNegativeTest-322309005 Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 3539cabdbfa943a49368f866270a776b Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesNegativeTest-322309005 Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesNegativeTest-322309005-project Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: fe0be3efded64c04ad05b984b52c534f Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesNegativeTest-322309005-project Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 901f8dc1-4c47-48e0-ba54-48027313cf3d could not be found. Jul 11 21:09:30.518827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '901f8dc1-4c47-48e0-ba54-48027313cf3d'} Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901f8dc1-4c47-48e0-ba54-48027313cf3d could not be found. Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:09:30.519939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901f8dc1-4c47-48e0-ba54-48027313cf3d could not be found. Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901f8dc1-4c47-48e0-ba54-48027313cf3d could not be found. Jul 11 21:09:30.521630 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:09:30.523011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] Returning 404 to user: Instance 901f8dc1-4c47-48e0-ba54-48027313cf3d could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:09:30.523011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-141cc9c6-55f4-44a5-be13-9a2000bac1ba tempest-VolumesNegativeTest-322309005 tempest-VolumesNegativeTest-322309005-project] 10.222.0.20 "GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d" status: 404 len: 111 microversion: 2.1 time: 0.034921 Jul 11 21:09:30.523011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 535/1061] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:09:30 2022] GET /compute/v2.1/servers/901f8dc1-4c47-48e0-ba54-48027313cf3d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:10:29.450185 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=7 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:29.451512 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=19 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:29.454207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-1537713c-47d3-421d-9c2c-f71ee5784f8c req-6075a3bb-23a8-4d3d-b7b0-59ca3783f623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2606d8-c53b-4b15-a39d-5bb8f364ceb0", "tag": "1b700fff-4710-4b5d-b1f9-7e44e3268d34"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:10:29.457412 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7580c643-be9f-4b2a-a19c-256bfd16f306 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:29.458102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7580c643-be9f-4b2a-a19c-256bfd16f306 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:29.458557 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=5 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:29.459531 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=11 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:29.465267 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-1537713c-47d3-421d-9c2c-f71ee5784f8c req-6075a3bb-23a8-4d3d-b7b0-59ca3783f623 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:29.465696 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-1537713c-47d3-421d-9c2c-f71ee5784f8c req-6075a3bb-23a8-4d3d-b7b0-59ca3783f623 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:29.466469 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7580c643-be9f-4b2a-a19c-256bfd16f306 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:29.466985 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7580c643-be9f-4b2a-a19c-256bfd16f306 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:29.467900 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7580c643-be9f-4b2a-a19c-256bfd16f306 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:29.469295 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7580c643-be9f-4b2a-a19c-256bfd16f306 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:29.478136 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-1537713c-47d3-421d-9c2c-f71ee5784f8c req-6075a3bb-23a8-4d3d-b7b0-59ca3783f623 service nova] Creating event network-changed:1b700fff-4710-4b5d-b1f9-7e44e3268d34 for instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 on hv-cinder-84902 Jul 11 21:10:29.485022 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-1537713c-47d3-421d-9c2c-f71ee5784f8c req-6075a3bb-23a8-4d3d-b7b0-59ca3783f623 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034798 Jul 11 21:10:29.485925 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 536/1062] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:10:29.498101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7580c643-be9f-4b2a-a19c-256bfd16f306 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:10:29.591342 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7580c643-be9f-4b2a-a19c-256bfd16f306 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 204 len: 0 microversion: 2.1 time: 0.142882 Jul 11 21:10:29.592179 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 527/1063] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:10:29 2022] DELETE /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:10:29.601753 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-80a391a1-bced-4c01-952b-44c81e74e95e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:29.602350 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-80a391a1-bced-4c01-952b-44c81e74e95e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:29.610307 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-80a391a1-bced-4c01-952b-44c81e74e95e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:29.610756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-80a391a1-bced-4c01-952b-44c81e74e95e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:29.611710 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-80a391a1-bced-4c01-952b-44c81e74e95e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:29.612187 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-80a391a1-bced-4c01-952b-44c81e74e95e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:29.750090 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-80a391a1-bced-4c01-952b-44c81e74e95e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:29.758513 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-80a391a1-bced-4c01-952b-44c81e74e95e tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1577 microversion: 2.1 time: 0.161578 Jul 11 21:10:29.759079 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 537/1064] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:29 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:10:30.781940 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-68e5ce61-dbbc-47db-bc9d-a9e2dc4fe09f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:30.782576 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-68e5ce61-dbbc-47db-bc9d-a9e2dc4fe09f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:30.789483 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-68e5ce61-dbbc-47db-bc9d-a9e2dc4fe09f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:30.789929 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-68e5ce61-dbbc-47db-bc9d-a9e2dc4fe09f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:30.790697 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-68e5ce61-dbbc-47db-bc9d-a9e2dc4fe09f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:30.791140 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-68e5ce61-dbbc-47db-bc9d-a9e2dc4fe09f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:31.022369 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-68e5ce61-dbbc-47db-bc9d-a9e2dc4fe09f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:31.031036 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-68e5ce61-dbbc-47db-bc9d-a9e2dc4fe09f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1577 microversion: 2.1 time: 0.255114 Jul 11 21:10:31.031593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 528/1065] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:30 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1577 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:32.055101 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a552e260-59d3-4e98-9165-8ce4baa6ae37 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:32.056047 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a552e260-59d3-4e98-9165-8ce4baa6ae37 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:32.067948 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a552e260-59d3-4e98-9165-8ce4baa6ae37 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:32.068764 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a552e260-59d3-4e98-9165-8ce4baa6ae37 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:32.070026 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a552e260-59d3-4e98-9165-8ce4baa6ae37 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:32.070757 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a552e260-59d3-4e98-9165-8ce4baa6ae37 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:32.216844 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a552e260-59d3-4e98-9165-8ce4baa6ae37 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:32.224403 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a552e260-59d3-4e98-9165-8ce4baa6ae37 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1459 microversion: 2.1 time: 0.176243 Jul 11 21:10:32.224962 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 538/1066] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:32 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1459 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:32.848849 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-9b6e2a49-6fbb-4779-80e4-681aeca01ae3 req-450fb2f1-3c89-48f4-bfd5-7ff6544822a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2606d8-c53b-4b15-a39d-5bb8f364ceb0", "name": "network-vif-deleted", "tag": "1b700fff-4710-4b5d-b1f9-7e44e3268d34"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:10:32.858703 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-9b6e2a49-6fbb-4779-80e4-681aeca01ae3 req-450fb2f1-3c89-48f4-bfd5-7ff6544822a0 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:32.859144 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-9b6e2a49-6fbb-4779-80e4-681aeca01ae3 req-450fb2f1-3c89-48f4-bfd5-7ff6544822a0 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:32.872993 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-9b6e2a49-6fbb-4779-80e4-681aeca01ae3 req-450fb2f1-3c89-48f4-bfd5-7ff6544822a0 service nova] Creating event network-vif-deleted:1b700fff-4710-4b5d-b1f9-7e44e3268d34 for instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 on hv-cinder-84902 Jul 11 21:10:32.878892 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-9b6e2a49-6fbb-4779-80e4-681aeca01ae3 req-450fb2f1-3c89-48f4-bfd5-7ff6544822a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034667 Jul 11 21:10:32.879500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 529/1067] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:10:33.240795 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3f6648ac-efad-4eda-8f6d-d70e2c73cb1a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:33.241309 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3f6648ac-efad-4eda-8f6d-d70e2c73cb1a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:33.250156 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3f6648ac-efad-4eda-8f6d-d70e2c73cb1a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:33.251058 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3f6648ac-efad-4eda-8f6d-d70e2c73cb1a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:33.252569 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3f6648ac-efad-4eda-8f6d-d70e2c73cb1a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:33.253168 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3f6648ac-efad-4eda-8f6d-d70e2c73cb1a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:33.325583 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3f6648ac-efad-4eda-8f6d-d70e2c73cb1a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:33.334344 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3f6648ac-efad-4eda-8f6d-d70e2c73cb1a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 200 len: 1224 microversion: 2.1 time: 0.097489 Jul 11 21:10:33.335080 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 539/1068] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:33 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:34.352190 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:34.352802 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:34.359436 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:34.359883 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:34.360696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:34.361131 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:34.374796 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] HTTP exception thrown: Instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 could not be found. Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Request method failure captured: Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 HTTP/1.1 Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI9x4U73Kz35Yd0dee2LV9HDi39yMHQH6659EWPCnABZs3AR-vmF0in5c7nUYlNGbFBLc3TBVOWFN5C7atVV5qxFWrLG3X-K9bw3eaHIN5D-kzOwp63csCuuTUyK7Nn6J92-XIhNnBwXvM3cJH2tOFaGfzA5xsfFzQg4Bgw5ws3uwWI Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:10:34.376738 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ed25b82be2043b188d2682a5c01490a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 5f8c2e5e6c1b4833b0e9af0de8814d13 Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 could not be found. Jul 11 21:10:34.378256 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '0a2606d8-c53b-4b15-a39d-5bb8f364ceb0'} Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 could not be found. Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:10:34.379061 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 could not be found. Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 could not be found. Jul 11 21:10:34.380454 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:34.381655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Returning 404 to user: Instance 0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:10:34.381655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c73f1e03-82bb-4db3-9e88-55fd0e9815fa tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0" status: 404 len: 111 microversion: 2.1 time: 0.030948 Jul 11 21:10:34.381655 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 530/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:34 2022] GET /compute/v2.1/servers/0a2606d8-c53b-4b15-a39d-5bb8f364ceb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:10:38.886975 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-66d60d1b-e313-4cb8-9fc5-b7cbc782fd8f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:38.887672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-66d60d1b-e313-4cb8-9fc5-b7cbc782fd8f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:38.888786 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-9a02ef59-a3fa-452a-85b9-9dd94a5e37e3 req-aeab8714-5cd3-4c9c-a8ae-9023e111a061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ddede4-7286-447e-9b09-947fdc35bcec", "tag": "7ad2ae0e-ff81-4b5a-9775-83301f98f0cc"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:10:38.894594 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66d60d1b-e313-4cb8-9fc5-b7cbc782fd8f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:38.895117 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66d60d1b-e313-4cb8-9fc5-b7cbc782fd8f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:38.895921 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66d60d1b-e313-4cb8-9fc5-b7cbc782fd8f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:38.896431 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-66d60d1b-e313-4cb8-9fc5-b7cbc782fd8f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:38.897840 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-9a02ef59-a3fa-452a-85b9-9dd94a5e37e3 req-aeab8714-5cd3-4c9c-a8ae-9023e111a061 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:38.898488 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-9a02ef59-a3fa-452a-85b9-9dd94a5e37e3 req-aeab8714-5cd3-4c9c-a8ae-9023e111a061 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:38.911182 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-9a02ef59-a3fa-452a-85b9-9dd94a5e37e3 req-aeab8714-5cd3-4c9c-a8ae-9023e111a061 service nova] Creating event network-changed:7ad2ae0e-ff81-4b5a-9775-83301f98f0cc for instance a1ddede4-7286-447e-9b09-947fdc35bcec on hv-cinder-84902 Jul 11 21:10:38.916692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-9a02ef59-a3fa-452a-85b9-9dd94a5e37e3 req-aeab8714-5cd3-4c9c-a8ae-9023e111a061 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031477 Jul 11 21:10:38.917265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 531/1070] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:10:38.923401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-66d60d1b-e313-4cb8-9fc5-b7cbc782fd8f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:10:39.012358 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-66d60d1b-e313-4cb8-9fc5-b7cbc782fd8f tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 204 len: 0 microversion: 2.1 time: 0.129306 Jul 11 21:10:39.013242 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 540/1071] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:10:38 2022] DELETE /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:10:39.022698 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a0870e16-dc2e-4f03-a482-22bc8b2faa72 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:39.023392 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a0870e16-dc2e-4f03-a482-22bc8b2faa72 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:39.029758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a0870e16-dc2e-4f03-a482-22bc8b2faa72 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:39.030201 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a0870e16-dc2e-4f03-a482-22bc8b2faa72 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:39.030956 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a0870e16-dc2e-4f03-a482-22bc8b2faa72 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:39.031383 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a0870e16-dc2e-4f03-a482-22bc8b2faa72 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:39.177554 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a0870e16-dc2e-4f03-a482-22bc8b2faa72 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:39.185904 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a0870e16-dc2e-4f03-a482-22bc8b2faa72 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1578 microversion: 2.1 time: 0.168019 Jul 11 21:10:39.186442 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 532/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:39 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:10:40.205036 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d71174bc-977e-4edc-9683-ff5e120d307a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:40.205836 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d71174bc-977e-4edc-9683-ff5e120d307a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:40.212595 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d71174bc-977e-4edc-9683-ff5e120d307a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:40.213037 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d71174bc-977e-4edc-9683-ff5e120d307a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:40.213919 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d71174bc-977e-4edc-9683-ff5e120d307a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:40.214350 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d71174bc-977e-4edc-9683-ff5e120d307a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:40.352023 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d71174bc-977e-4edc-9683-ff5e120d307a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:40.359812 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d71174bc-977e-4edc-9683-ff5e120d307a tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1459 microversion: 2.1 time: 0.159549 Jul 11 21:10:40.360807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 541/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:40 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1459 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:40.932634 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-66a6aaa3-d364-41a8-9849-88fc255dc2a1 req-0a86809a-32c5-4ca1-b983-b707fe00aa7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ddede4-7286-447e-9b09-947fdc35bcec", "name": "network-vif-deleted", "tag": "7ad2ae0e-ff81-4b5a-9775-83301f98f0cc"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:10:40.941858 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-66a6aaa3-d364-41a8-9849-88fc255dc2a1 req-0a86809a-32c5-4ca1-b983-b707fe00aa7e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:40.942335 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-66a6aaa3-d364-41a8-9849-88fc255dc2a1 req-0a86809a-32c5-4ca1-b983-b707fe00aa7e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:40.953640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-66a6aaa3-d364-41a8-9849-88fc255dc2a1 req-0a86809a-32c5-4ca1-b983-b707fe00aa7e service nova] Creating event network-vif-deleted:7ad2ae0e-ff81-4b5a-9775-83301f98f0cc for instance a1ddede4-7286-447e-9b09-947fdc35bcec on hv-cinder-84902 Jul 11 21:10:40.959128 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-66a6aaa3-d364-41a8-9849-88fc255dc2a1 req-0a86809a-32c5-4ca1-b983-b707fe00aa7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030171 Jul 11 21:10:40.959708 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 533/1074] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:10:41.380674 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-731167a6-0d68-4093-a6bc-a4dd78608a78 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:41.381282 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-731167a6-0d68-4093-a6bc-a4dd78608a78 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:41.388264 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-731167a6-0d68-4093-a6bc-a4dd78608a78 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:41.388883 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-731167a6-0d68-4093-a6bc-a4dd78608a78 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:41.389686 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-731167a6-0d68-4093-a6bc-a4dd78608a78 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:41.390124 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-731167a6-0d68-4093-a6bc-a4dd78608a78 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:41.462936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-731167a6-0d68-4093-a6bc-a4dd78608a78 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:41.473646 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-731167a6-0d68-4093-a6bc-a4dd78608a78 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1225 microversion: 2.1 time: 0.098244 Jul 11 21:10:41.474207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 542/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:41 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:42.496627 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4cd555ea-71e4-4839-859f-7c5233377223 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:42.497726 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-4cd555ea-71e4-4839-859f-7c5233377223 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:42.508322 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4cd555ea-71e4-4839-859f-7c5233377223 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:42.509058 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4cd555ea-71e4-4839-859f-7c5233377223 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:42.510307 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4cd555ea-71e4-4839-859f-7c5233377223 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:42.511014 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-4cd555ea-71e4-4839-859f-7c5233377223 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:42.578154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-4cd555ea-71e4-4839-859f-7c5233377223 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:42.586510 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4cd555ea-71e4-4839-859f-7c5233377223 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1225 microversion: 2.1 time: 0.097752 Jul 11 21:10:42.587067 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 534/1076] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:42 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:43.607795 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e21eeadb-7147-49f5-9cef-d04a99837b8d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:43.608790 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e21eeadb-7147-49f5-9cef-d04a99837b8d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:43.619848 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e21eeadb-7147-49f5-9cef-d04a99837b8d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:43.620643 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e21eeadb-7147-49f5-9cef-d04a99837b8d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:43.621944 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e21eeadb-7147-49f5-9cef-d04a99837b8d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:43.622652 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e21eeadb-7147-49f5-9cef-d04a99837b8d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:43.691188 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e21eeadb-7147-49f5-9cef-d04a99837b8d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:43.700844 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e21eeadb-7147-49f5-9cef-d04a99837b8d tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1225 microversion: 2.1 time: 0.099577 Jul 11 21:10:43.701422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 543/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:43 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:44.723382 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d7c486ab-94a3-42ae-a114-5b161acbb9d2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:44.723913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d7c486ab-94a3-42ae-a114-5b161acbb9d2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:44.731223 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7c486ab-94a3-42ae-a114-5b161acbb9d2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:44.731687 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7c486ab-94a3-42ae-a114-5b161acbb9d2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:44.732521 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7c486ab-94a3-42ae-a114-5b161acbb9d2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:44.732968 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d7c486ab-94a3-42ae-a114-5b161acbb9d2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:44.808093 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d7c486ab-94a3-42ae-a114-5b161acbb9d2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:44.817319 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d7c486ab-94a3-42ae-a114-5b161acbb9d2 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1225 microversion: 2.1 time: 0.098087 Jul 11 21:10:44.818032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 535/1078] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:44 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:45.839200 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a182d87b-5968-4141-9a75-80dffc7169a5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:45.839833 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a182d87b-5968-4141-9a75-80dffc7169a5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:45.849307 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a182d87b-5968-4141-9a75-80dffc7169a5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:45.849746 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a182d87b-5968-4141-9a75-80dffc7169a5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:45.850512 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a182d87b-5968-4141-9a75-80dffc7169a5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:45.850942 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a182d87b-5968-4141-9a75-80dffc7169a5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:45.913360 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a182d87b-5968-4141-9a75-80dffc7169a5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:45.921310 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a182d87b-5968-4141-9a75-80dffc7169a5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1225 microversion: 2.1 time: 0.089443 Jul 11 21:10:45.921872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 544/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:45 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:46.948012 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f30cbac6-c19f-47b8-9ee7-2b47f927ece4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:46.948926 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f30cbac6-c19f-47b8-9ee7-2b47f927ece4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:46.958594 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f30cbac6-c19f-47b8-9ee7-2b47f927ece4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:46.959042 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f30cbac6-c19f-47b8-9ee7-2b47f927ece4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:46.959808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f30cbac6-c19f-47b8-9ee7-2b47f927ece4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:46.960273 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f30cbac6-c19f-47b8-9ee7-2b47f927ece4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:47.024574 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f30cbac6-c19f-47b8-9ee7-2b47f927ece4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8c2e5e6c1b4833b0e9af0de8814d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed25b82be2043b188d2682a5c01490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:10:47.036174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f30cbac6-c19f-47b8-9ee7-2b47f927ece4 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 200 len: 1225 microversion: 2.1 time: 0.095335 Jul 11 21:10:47.036972 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 536/1080] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:46 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:10:48.061584 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:48.062404 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: a1ddede4-7286-447e-9b09-947fdc35bcec] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:48.070395 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:48.070837 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:48.071591 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:48.072021 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:48.088397 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] HTTP exception thrown: Instance a1ddede4-7286-447e-9b09-947fdc35bcec could not be found. Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Request method failure captured: Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec HTTP/1.1 Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI9x4U73Kz35Yd0dee2LV9HDi39yMHQH6659EWPCnABZs3AR-vmF0in5c7nUYlNGbFBLc3TBVOWFN5C7atVV5qxFWrLG3X-K9bw3eaHIN5D-kzOwp63csCuuTUyK7Nn6J92-XIhNnBwXvM3cJH2tOFaGfzA5xsfFzQg4Bgw5ws3uwWI Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:10:48.090011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ed25b82be2043b188d2682a5c01490a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 5f8c2e5e6c1b4833b0e9af0de8814d13 Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance a1ddede4-7286-447e-9b09-947fdc35bcec could not be found. Jul 11 21:10:48.091642 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'a1ddede4-7286-447e-9b09-947fdc35bcec'} Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ddede4-7286-447e-9b09-947fdc35bcec could not be found. Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:10:48.092644 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ddede4-7286-447e-9b09-947fdc35bcec could not be found. Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ddede4-7286-447e-9b09-947fdc35bcec could not be found. Jul 11 21:10:48.094252 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.095683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Returning 404 to user: Instance a1ddede4-7286-447e-9b09-947fdc35bcec could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:10:48.095683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-cd2d1322-5eb1-4ee3-aedd-4995e7308ad5 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec" status: 404 len: 111 microversion: 2.1 time: 0.035552 Jul 11 21:10:48.095683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 545/1081] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:48 2022] GET /compute/v2.1/servers/a1ddede4-7286-447e-9b09-947fdc35bcec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:10:48.546180 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:48.546721 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:48.555238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:48.555688 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:48.556449 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:48.556920 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:48.572870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] HTTP exception thrown: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Request method failure captured: Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: DELETE /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 HTTP/1.1 Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizI9x4U73Kz35Yd0dee2LV9HDi39yMHQH6659EWPCnABZs3AR-vmF0in5c7nUYlNGbFBLc3TBVOWFN5C7atVV5qxFWrLG3X-K9bw3eaHIN5D-kzOwp63csCuuTUyK7Nn6J92-XIhNnBwXvM3cJH2tOFaGfzA5xsfFzQg4Bgw5ws3uwWI Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:10:48.574467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ed25b82be2043b188d2682a5c01490a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 5f8c2e5e6c1b4833b0e9af0de8814d13 Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.576021 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': 'aab48eb9-c7dd-477d-9722-c03b4e165059'} Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:10:48.576838 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.578333 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.580007 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Returning 404 to user: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:10:48.580007 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bbd66a34-03ac-40fb-b4ec-cccbd36bab44 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 404 len: 111 microversion: 2.1 time: 0.035543 Jul 11 21:10:48.580007 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 537/1082] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:10:48 2022] DELETE /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:10:48.585675 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:48.586290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] [instance: aab48eb9-c7dd-477d-9722-c03b4e165059] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:48.592595 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:48.593045 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:48.593805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:48.594238 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:48.607810 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] HTTP exception thrown: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Request method failure captured: Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 HTTP/1.1 Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizI9x4U73Kz35Yd0dee2LV9HDi39yMHQH6659EWPCnABZs3AR-vmF0in5c7nUYlNGbFBLc3TBVOWFN5C7atVV5qxFWrLG3X-K9bw3eaHIN5D-kzOwp63csCuuTUyK7Nn6J92-XIhNnBwXvM3cJH2tOFaGfzA5xsfFzQg4Bgw5ws3uwWI Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:10:48.609366 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ed25b82be2043b188d2682a5c01490a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ed25b82be2043b188d2682a5c01490a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 6ed25b82be2043b188d2682a5c01490a Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-TestVolumeBootPattern-413949471 Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 5f8c2e5e6c1b4833b0e9af0de8814d13 Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-TestVolumeBootPattern-413949471-project Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.610865 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'aab48eb9-c7dd-477d-9722-c03b4e165059'} Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:10:48.611673 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. Jul 11 21:10:48.613611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:10:48.615067 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Returning 404 to user: Instance aab48eb9-c7dd-477d-9722-c03b4e165059 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:10:48.615067 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3e040a67-828a-4539-95a3-95de92025b03 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059" status: 404 len: 111 microversion: 2.1 time: 0.029286 Jul 11 21:10:48.615067 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 546/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:48 2022] GET /compute/v2.1/servers/aab48eb9-c7dd-477d-9722-c03b4e165059 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:10:49.936568 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-aeba200e-2950-4fc4-9eb5-d27c24ba8898 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] Calling method '.version_select at 0x7f3840fd3820>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:49.957041 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-aeba200e-2950-4fc4-9eb5-d27c24ba8898 tempest-TestVolumeBootPattern-413949471 tempest-TestVolumeBootPattern-413949471-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-538925586" status: 202 len: 0 microversion: 2.1 time: 0.024738 Jul 11 21:10:49.958194 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 538/1084] 10.222.0.20 () {58 vars in 1259 bytes} [Mon Jul 11 21:10:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-538925586 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:10:52.315725 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:10:52.316597 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Mon Jul 11 21:10:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:10:59.347525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:59.348190 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:59.582626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c7afe9c4-2d8f-41e3-9495-932984ed1d51 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:59.583120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-c7afe9c4-2d8f-41e3-9495-932984ed1d51 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:59.589430 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c7afe9c4-2d8f-41e3-9495-932984ed1d51 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:59.589870 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c7afe9c4-2d8f-41e3-9495-932984ed1d51 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:59.590628 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c7afe9c4-2d8f-41e3-9495-932984ed1d51 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:59.591056 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-c7afe9c4-2d8f-41e3-9495-932984ed1d51 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:59.615240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c7afe9c4-2d8f-41e3-9495-932984ed1d51 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88/ips" status: 200 len: 149 microversion: 2.1 time: 0.272664 Jul 11 21:10:59.615842 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 547/1085] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 21:10:59 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88/ips => generated 149 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:10:59.623880 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:59.628057 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1830b2eb-3f97-43ce-86e3-3517caa594d5"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:10:59.629132 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:59.630885 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:59.638210 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:59.638637 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:59.639400 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:59.639832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:59.725212 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Invalid volume: volume 1830b2eb-3f97-43ce-86e3-3517caa594d5 is already attached to instances: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: POST /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88/os-volume_attachments HTTP/1.1 Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 74 Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:10:59.726965 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {"volumeAttachment": {"volumeId": "1830b2eb-3f97-43ce-86e3-3517caa594d5"}} Jul 11 21:10:59.728666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Invalid volume: volume 1830b2eb-3f97-43ce-86e3-3517caa594d5 is already attached to instances: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'server_id': '861d2bea-e420-47e3-95f6-6dcfde4e7d88', 'body': {'volumeAttachment': {'volumeId': '1830b2eb-3f97-43ce-86e3-3517caa594d5'}}} Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1830b2eb-3f97-43ce-86e3-3517caa594d5 is already attached to instances: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:59.729673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1830b2eb-3f97-43ce-86e3-3517caa594d5 is already attached to instances: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:10:59.731174 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:10:59.732692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:10:59.732692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:10:59.732692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:10:59.732692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1830b2eb-3f97-43ce-86e3-3517caa594d5 is already attached to instances: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 Jul 11 21:10:59.732692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:10:59.732692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 400 to user: Invalid volume: volume 1830b2eb-3f97-43ce-86e3-3517caa594d5 is already attached to instances: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:10:59.732692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e010c455-e48c-4bde-8791-8f4caef5b45d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106000 Jul 11 21:10:59.732692 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 539/1086] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:10:59 2022] POST /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 21:10:59.737313 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1879ec47-a970-4b5d-9fca-b1a717b45725 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:59.737821 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1879ec47-a970-4b5d-9fca-b1a717b45725 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:59.744415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1879ec47-a970-4b5d-9fca-b1a717b45725 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:59.744838 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1879ec47-a970-4b5d-9fca-b1a717b45725 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:59.745604 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1879ec47-a970-4b5d-9fca-b1a717b45725 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:59.746040 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1879ec47-a970-4b5d-9fca-b1a717b45725 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:59.770859 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1879ec47-a970-4b5d-9fca-b1a717b45725 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:10:59.860021 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1879ec47-a970-4b5d-9fca-b1a717b45725 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 204 len: 0 microversion: 2.1 time: 0.126373 Jul 11 21:10:59.860785 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 548/1087] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:10:59 2022] DELETE /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:10:59.869762 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-918cfa92-f6ab-4d03-a02f-66c155add0ea tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:10:59.870286 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-918cfa92-f6ab-4d03-a02f-66c155add0ea tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:10:59.877188 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-918cfa92-f6ab-4d03-a02f-66c155add0ea tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:59.877628 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-918cfa92-f6ab-4d03-a02f-66c155add0ea tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:10:59.878426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-918cfa92-f6ab-4d03-a02f-66c155add0ea tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:10:59.878859 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-918cfa92-f6ab-4d03-a02f-66c155add0ea tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:00.021975 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-918cfa92-f6ab-4d03-a02f-66c155add0ea tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:00.029701 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-918cfa92-f6ab-4d03-a02f-66c155add0ea tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1681 microversion: 2.1 time: 0.164042 Jul 11 21:11:00.030236 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 540/1088] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:10:59 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:01.055351 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-02dd8d48-9c12-4616-afad-3922c9ba41d3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:01.056036 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-02dd8d48-9c12-4616-afad-3922c9ba41d3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:01.064016 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-02dd8d48-9c12-4616-afad-3922c9ba41d3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:01.064573 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-02dd8d48-9c12-4616-afad-3922c9ba41d3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:01.065463 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-02dd8d48-9c12-4616-afad-3922c9ba41d3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:01.065970 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-02dd8d48-9c12-4616-afad-3922c9ba41d3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:01.200939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-02dd8d48-9c12-4616-afad-3922c9ba41d3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:01.208589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-02dd8d48-9c12-4616-afad-3922c9ba41d3 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1681 microversion: 2.1 time: 0.160307 Jul 11 21:11:01.209173 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 549/1089] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:01 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:02.227791 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ed607ecf-b9ab-4a2f-9060-c69401f7c7c6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:02.229101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ed607ecf-b9ab-4a2f-9060-c69401f7c7c6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:02.235371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed607ecf-b9ab-4a2f-9060-c69401f7c7c6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:02.235812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed607ecf-b9ab-4a2f-9060-c69401f7c7c6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:02.236609 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed607ecf-b9ab-4a2f-9060-c69401f7c7c6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:02.237070 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed607ecf-b9ab-4a2f-9060-c69401f7c7c6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:02.326516 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ed607ecf-b9ab-4a2f-9060-c69401f7c7c6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:02.334303 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ed607ecf-b9ab-4a2f-9060-c69401f7c7c6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 200 len: 1614 microversion: 2.1 time: 0.111478 Jul 11 21:11:02.335222 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 541/1090] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:02 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:02.552290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-7dd04fcf-026c-4679-94ec-e7c4ad229bb0 req-50d2b237-ac39-4bf9-8ae5-668d2ad36f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861d2bea-e420-47e3-95f6-6dcfde4e7d88", "name": "network-vif-deleted", "tag": "80759534-ed8a-4ac4-99d1-330bda28ad63"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:11:02.567416 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-7dd04fcf-026c-4679-94ec-e7c4ad229bb0 req-50d2b237-ac39-4bf9-8ae5-668d2ad36f02 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:02.568237 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-7dd04fcf-026c-4679-94ec-e7c4ad229bb0 req-50d2b237-ac39-4bf9-8ae5-668d2ad36f02 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:02.582743 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-7dd04fcf-026c-4679-94ec-e7c4ad229bb0 req-50d2b237-ac39-4bf9-8ae5-668d2ad36f02 service nova] Creating event network-vif-deleted:80759534-ed8a-4ac4-99d1-330bda28ad63 for instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 on hv-cinder-84902 Jul 11 21:11:02.589530 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-7dd04fcf-026c-4679-94ec-e7c4ad229bb0 req-50d2b237-ac39-4bf9-8ae5-668d2ad36f02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040830 Jul 11 21:11:02.590807 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 550/1091] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:11:03.351137 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:03.351912 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:03.358681 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:03.359120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:03.359872 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:03.360335 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:03.374262 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 HTTP/1.1 Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:11:03.376088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:11:03.377683 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '861d2bea-e420-47e3-95f6-6dcfde4e7d88'} Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:11:03.378562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:11:03.380162 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:11:03.382035 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:11:03.382035 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6869743f-7774-42c6-853b-6b3661c0049b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 404 len: 111 microversion: 2.1 time: 0.030430 Jul 11 21:11:03.382035 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 542/1092] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:03 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:11:03.387710 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c751650a-7f0d-4052-904c-5774c07650b9 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '.version_select at 0x7f384018d3a0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:03.408206 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c751650a-7f0d-4052-904c-5774c07650b9 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049147502" status: 202 len: 0 microversion: 2.1 time: 0.024656 Jul 11 21:11:03.408983 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 551/1093] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jul 11 21:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049147502 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 21:11:04.083970 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-78ba6449-2e82-493b-ba87-667edc93845b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:04.084801 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-78ba6449-2e82-493b-ba87-667edc93845b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:04.091247 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-78ba6449-2e82-493b-ba87-667edc93845b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:04.091695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-78ba6449-2e82-493b-ba87-667edc93845b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:04.092485 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-78ba6449-2e82-493b-ba87-667edc93845b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:04.092927 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-78ba6449-2e82-493b-ba87-667edc93845b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:04.191329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-78ba6449-2e82-493b-ba87-667edc93845b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lazy-loading 'services' on Instance uuid 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:11:04.284775 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-78ba6449-2e82-493b-ba87-667edc93845b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-volume_attachments/1830b2eb-3f97-43ce-86e3-3517caa594d5" status: 202 len: 0 microversion: 2.1 time: 0.204713 Jul 11 21:11:04.285377 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 543/1094] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:11:04 2022] DELETE /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-volume_attachments/1830b2eb-3f97-43ce-86e3-3517caa594d5 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:11:04.294412 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5edf633b-b29e-4b83-9c29-2cd18ed51b1a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:04.295439 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-5edf633b-b29e-4b83-9c29-2cd18ed51b1a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:04.303170 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5edf633b-b29e-4b83-9c29-2cd18ed51b1a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:04.303740 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5edf633b-b29e-4b83-9c29-2cd18ed51b1a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:04.304599 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5edf633b-b29e-4b83-9c29-2cd18ed51b1a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:04.305056 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-5edf633b-b29e-4b83-9c29-2cd18ed51b1a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:04.336065 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5edf633b-b29e-4b83-9c29-2cd18ed51b1a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046025 Jul 11 21:11:04.336684 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 552/1095] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:11:04 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:11:05.348989 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-225d4de5-67e8-4365-8772-e59e04854acf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:05.349981 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-225d4de5-67e8-4365-8772-e59e04854acf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:05.356531 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-225d4de5-67e8-4365-8772-e59e04854acf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:05.356980 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-225d4de5-67e8-4365-8772-e59e04854acf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:05.357740 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-225d4de5-67e8-4365-8772-e59e04854acf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:05.358304 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-225d4de5-67e8-4365-8772-e59e04854acf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:05.389745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-225d4de5-67e8-4365-8772-e59e04854acf tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045759 Jul 11 21:11:05.390395 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 544/1096] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:11:05 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 21:11:05.450930 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-77bbe3ec-e16f-4a7d-aa06-097f09f4b763 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:05.451461 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-77bbe3ec-e16f-4a7d-aa06-097f09f4b763 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:05.458127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-77bbe3ec-e16f-4a7d-aa06-097f09f4b763 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:05.458576 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-77bbe3ec-e16f-4a7d-aa06-097f09f4b763 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:05.459348 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-77bbe3ec-e16f-4a7d-aa06-097f09f4b763 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:05.460391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-77bbe3ec-e16f-4a7d-aa06-097f09f4b763 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:05.485228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-77bbe3ec-e16f-4a7d-aa06-097f09f4b763 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Going to try to terminate instance {{(pid=118013) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:11:05.565932 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-77bbe3ec-e16f-4a7d-aa06-097f09f4b763 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 204 len: 0 microversion: 2.1 time: 0.118563 Jul 11 21:11:05.566627 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 553/1097] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:11:05 2022] DELETE /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:11:05.575263 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-11d0091b-589c-4f91-a70a-728fb35cedd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:05.575880 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-11d0091b-589c-4f91-a70a-728fb35cedd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:05.582200 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11d0091b-589c-4f91-a70a-728fb35cedd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:05.582640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11d0091b-589c-4f91-a70a-728fb35cedd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:05.583394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11d0091b-589c-4f91-a70a-728fb35cedd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:05.583818 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11d0091b-589c-4f91-a70a-728fb35cedd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:05.762210 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-11d0091b-589c-4f91-a70a-728fb35cedd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:05.769836 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-11d0091b-589c-4f91-a70a-728fb35cedd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1684 microversion: 2.1 time: 0.198732 Jul 11 21:11:05.770413 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 545/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:05 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1684 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:06.788365 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e9781d0b-77b8-417f-88d3-588621b9a21c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:06.789149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e9781d0b-77b8-417f-88d3-588621b9a21c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:06.796407 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e9781d0b-77b8-417f-88d3-588621b9a21c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:06.797287 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e9781d0b-77b8-417f-88d3-588621b9a21c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:06.798175 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e9781d0b-77b8-417f-88d3-588621b9a21c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:06.798651 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e9781d0b-77b8-417f-88d3-588621b9a21c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:07.127012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e9781d0b-77b8-417f-88d3-588621b9a21c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:07.135714 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e9781d0b-77b8-417f-88d3-588621b9a21c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 200 len: 1684 microversion: 2.1 time: 0.352226 Jul 11 21:11:07.136419 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 554/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:06 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 1684 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:07.569925 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-a8d5b70d-d5b0-4780-bbad-2c231d190acc req-0e7c2f65-d166-4d76-a538-e83e0542c93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a34d34e-5069-4a9b-bd8e-aee28a2e4668", "name": "network-vif-deleted", "tag": "72f6522e-b9a9-4ae8-bdf6-f69ca8c66521"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:11:07.582852 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-a8d5b70d-d5b0-4780-bbad-2c231d190acc req-0e7c2f65-d166-4d76-a538-e83e0542c93e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:07.583591 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-a8d5b70d-d5b0-4780-bbad-2c231d190acc req-0e7c2f65-d166-4d76-a538-e83e0542c93e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:07.599289 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-a8d5b70d-d5b0-4780-bbad-2c231d190acc req-0e7c2f65-d166-4d76-a538-e83e0542c93e service nova] Creating event network-vif-deleted:72f6522e-b9a9-4ae8-bdf6-f69ca8c66521 for instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 on hv-cinder-84902 Jul 11 21:11:07.605050 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-a8d5b70d-d5b0-4780-bbad-2c231d190acc req-0e7c2f65-d166-4d76-a538-e83e0542c93e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040238 Jul 11 21:11:07.606310 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 546/1100] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:11:08.155249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:08.156827 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:08.164675 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:08.165146 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:08.165948 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:08.166377 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:08.185836 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 HTTP/1.1 Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:11:08.187672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:11:08.189229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '1a34d34e-5069-4a9b-bd8e-aee28a2e4668'} Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:11:08.190044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:11:08.191330 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:11:08.192520 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:11:08.192520 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-07db65b1-5dd1-4307-8da6-be42be941773 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 404 len: 111 microversion: 2.1 time: 0.040560 Jul 11 21:11:08.195552 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 555/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:08 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 21:11:08.201020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6daa957c-472e-4ff1-b85d-d8226598358a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '.version_select at 0x7f3840236a60>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:08.221139 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6daa957c-472e-4ff1-b85d-d8226598358a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590383589" status: 202 len: 0 microversion: 2.1 time: 0.025414 Jul 11 21:11:08.222414 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 547/1102] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jul 11 21:11:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590383589 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 21:11:09.178520 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ec5901f3-4c40-4d3b-af65-a9a055fd216e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: .version_select at 0x7f384014ab80>, body: {"keypair": {"name": "tempest-keypair-44123784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBRZiuGDvWp2r9MHXqV3p289Q8HjBq+sgxzYYSr0eAP+ns+ie43GpWzyIugsSa/+AGFRQcMzcw6k2iuAx47oW6GwacJSBmNOWnXOGEslvH4lSJa1jctT/0Jsh78ATb+Cg=="}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:11:09.195546 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-ec5901f3-4c40-4d3b-af65-a9a055fd216e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:11:09.200151 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-ec5901f3-4c40-4d3b-af65-a9a055fd216e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for user 68f6997db7c141529c37cc64955df779 and project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'key_pairs'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:11:09.226639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ec5901f3-4c40-4d3b-af65-a9a055fd216e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.051758 Jul 11 21:11:09.227474 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 556/1103] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 21:11:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:11:10.550043 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-574495778", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "681ae82c-3a6d-44f5-9bef-155f92884bde"}], "security_groups": [{"name": "tempest-securitygroup--1535592788"}], "key_name": "tempest-keypair-44123784", "user_data": "}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:11:10.670724 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.network.neutron [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] validate_networks() for [('681ae82c-3a6d-44f5-9bef-155f92884bde', None, None, None, None, None)] {{(pid=118014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:11:11.187098 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Flavor limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:11:11.187548 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Image limits 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:11:11.188006 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Flavor pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:11:11.188452 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Image pref 0:0:0 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:11:11.188915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.virt.hardware [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:11:11.198737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:11.199181 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:11.199961 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:11.200420 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:11.217529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:11:11.221832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for user 68f6997db7c141529c37cc64955df779 and project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'ram', 'cores', 'instances'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:11:11.233737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Going to run 1 instances... {{(pid=118014) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:11:11.236143 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:11:11.287005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d32533c7-2126-4b65-9f4c-f8d5d3e9bab0 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.742145 Jul 11 21:11:11.288082 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 548/1104] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:11:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:11:11.299100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0ab2addd-43b5-4467-9254-30d36adc258c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:11.299803 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0ab2addd-43b5-4467-9254-30d36adc258c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:11.354587 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0ab2addd-43b5-4467-9254-30d36adc258c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:11.361402 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0ab2addd-43b5-4467-9254-30d36adc258c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1239 microversion: 2.1 time: 0.067322 Jul 11 21:11:11.361960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 557/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:11 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:12.379384 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8fec087c-546a-4577-b9ee-d0756bcdf3b5 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:12.380010 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8fec087c-546a-4577-b9ee-d0756bcdf3b5 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:12.387778 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fec087c-546a-4577-b9ee-d0756bcdf3b5 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:12.388645 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fec087c-546a-4577-b9ee-d0756bcdf3b5 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:12.389467 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fec087c-546a-4577-b9ee-d0756bcdf3b5 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:12.389896 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8fec087c-546a-4577-b9ee-d0756bcdf3b5 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:12.463139 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8fec087c-546a-4577-b9ee-d0756bcdf3b5 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:12.471141 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8fec087c-546a-4577-b9ee-d0756bcdf3b5 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1309 microversion: 2.1 time: 0.096216 Jul 11 21:11:12.471780 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 549/1106] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:12 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 21:11:13.488914 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a27ce816-6b82-4fab-bb66-921b581e7cbd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:13.489556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a27ce816-6b82-4fab-bb66-921b581e7cbd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:13.496661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a27ce816-6b82-4fab-bb66-921b581e7cbd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:13.497413 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a27ce816-6b82-4fab-bb66-921b581e7cbd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:13.498229 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a27ce816-6b82-4fab-bb66-921b581e7cbd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:13.498633 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a27ce816-6b82-4fab-bb66-921b581e7cbd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:13.656961 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a27ce816-6b82-4fab-bb66-921b581e7cbd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:13.665713 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a27ce816-6b82-4fab-bb66-921b581e7cbd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.180562 Jul 11 21:11:13.666589 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 558/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:13 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:14.114931 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-2dd5bcbb-57fe-4481-9656-a905468fa35f req-a9ef4cc2-4b61-4578-ae59-6711990c3fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf1bbec-8b13-42a5-aa9f-18029e20d2f4", "tag": "213eef57-1fc5-4f34-acc4-6258c35eb800"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:11:14.130352 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-2dd5bcbb-57fe-4481-9656-a905468fa35f req-a9ef4cc2-4b61-4578-ae59-6711990c3fc7 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:14.133341 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-2dd5bcbb-57fe-4481-9656-a905468fa35f req-a9ef4cc2-4b61-4578-ae59-6711990c3fc7 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:14.148648 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-2dd5bcbb-57fe-4481-9656-a905468fa35f req-a9ef4cc2-4b61-4578-ae59-6711990c3fc7 service nova] Creating event network-changed:213eef57-1fc5-4f34-acc4-6258c35eb800 for instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 on hv-cinder-84902 Jul 11 21:11:14.156380 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-2dd5bcbb-57fe-4481-9656-a905468fa35f req-a9ef4cc2-4b61-4578-ae59-6711990c3fc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048141 Jul 11 21:11:14.157096 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 550/1108] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:11:14.687626 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2258aaa6-4894-4745-97c3-4a36045b39a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:14.688472 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2258aaa6-4894-4745-97c3-4a36045b39a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:14.696520 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2258aaa6-4894-4745-97c3-4a36045b39a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:14.697004 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2258aaa6-4894-4745-97c3-4a36045b39a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:14.698341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2258aaa6-4894-4745-97c3-4a36045b39a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:14.698779 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2258aaa6-4894-4745-97c3-4a36045b39a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:14.838218 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2258aaa6-4894-4745-97c3-4a36045b39a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:14.846066 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2258aaa6-4894-4745-97c3-4a36045b39a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.164166 Jul 11 21:11:14.846624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 559/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:14 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:15.864875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-f1eba4bf-fc88-40ab-bab5-2791b859c79c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:15.865566 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-f1eba4bf-fc88-40ab-bab5-2791b859c79c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:15.872764 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1eba4bf-fc88-40ab-bab5-2791b859c79c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:15.873202 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1eba4bf-fc88-40ab-bab5-2791b859c79c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:15.873958 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1eba4bf-fc88-40ab-bab5-2791b859c79c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:15.874381 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-f1eba4bf-fc88-40ab-bab5-2791b859c79c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:16.006794 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-f1eba4bf-fc88-40ab-bab5-2791b859c79c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:16.014666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-f1eba4bf-fc88-40ab-bab5-2791b859c79c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.153945 Jul 11 21:11:16.015239 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 551/1110] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:15 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:17.035616 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1d3aa867-730f-4367-9cf3-974da1394901 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:17.036492 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1d3aa867-730f-4367-9cf3-974da1394901 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:17.046121 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1d3aa867-730f-4367-9cf3-974da1394901 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:17.046560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1d3aa867-730f-4367-9cf3-974da1394901 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:17.047671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1d3aa867-730f-4367-9cf3-974da1394901 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:17.048100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1d3aa867-730f-4367-9cf3-974da1394901 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:17.186429 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1d3aa867-730f-4367-9cf3-974da1394901 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:17.194413 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1d3aa867-730f-4367-9cf3-974da1394901 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.165464 Jul 11 21:11:17.194974 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 560/1111] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:17 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:18.216591 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-aa37abc0-79e6-4c5d-9d8b-7eeb3aa16713 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:18.217222 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-aa37abc0-79e6-4c5d-9d8b-7eeb3aa16713 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:18.224198 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aa37abc0-79e6-4c5d-9d8b-7eeb3aa16713 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:18.224693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aa37abc0-79e6-4c5d-9d8b-7eeb3aa16713 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:18.225635 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aa37abc0-79e6-4c5d-9d8b-7eeb3aa16713 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:18.226137 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-aa37abc0-79e6-4c5d-9d8b-7eeb3aa16713 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:18.372022 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-aa37abc0-79e6-4c5d-9d8b-7eeb3aa16713 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:18.379687 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-aa37abc0-79e6-4c5d-9d8b-7eeb3aa16713 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.169248 Jul 11 21:11:18.380254 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 552/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:18 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:19.396667 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-325dbea5-7379-4f9b-921c-3de4a03c5280 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:19.397275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-325dbea5-7379-4f9b-921c-3de4a03c5280 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:19.403805 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-325dbea5-7379-4f9b-921c-3de4a03c5280 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:19.404385 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-325dbea5-7379-4f9b-921c-3de4a03c5280 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:19.405167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-325dbea5-7379-4f9b-921c-3de4a03c5280 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:19.405619 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-325dbea5-7379-4f9b-921c-3de4a03c5280 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:19.549189 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-325dbea5-7379-4f9b-921c-3de4a03c5280 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:19.556766 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-325dbea5-7379-4f9b-921c-3de4a03c5280 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.164108 Jul 11 21:11:19.557539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 561/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:19 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:20.573807 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-2877b496-6c4e-4180-9ac9-f54f0ef3e425 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:20.574418 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-2877b496-6c4e-4180-9ac9-f54f0ef3e425 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:20.581283 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2877b496-6c4e-4180-9ac9-f54f0ef3e425 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:20.581733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2877b496-6c4e-4180-9ac9-f54f0ef3e425 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:20.582496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2877b496-6c4e-4180-9ac9-f54f0ef3e425 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:20.582928 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-2877b496-6c4e-4180-9ac9-f54f0ef3e425 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:20.720590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-2877b496-6c4e-4180-9ac9-f54f0ef3e425 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:20.728269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-2877b496-6c4e-4180-9ac9-f54f0ef3e425 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.158341 Jul 11 21:11:20.728882 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 553/1114] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:20 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:21.744357 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3a46224d-70dc-44a7-9be0-f090771aa886 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:21.745019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-3a46224d-70dc-44a7-9be0-f090771aa886 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:21.747570 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=6 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:21.753874 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3a46224d-70dc-44a7-9be0-f090771aa886 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:21.754322 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3a46224d-70dc-44a7-9be0-f090771aa886 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:21.755127 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3a46224d-70dc-44a7-9be0-f090771aa886 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:21.755512 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-3a46224d-70dc-44a7-9be0-f090771aa886 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:21.908216 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-3a46224d-70dc-44a7-9be0-f090771aa886 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:21.915816 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3a46224d-70dc-44a7-9be0-f090771aa886 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.175364 Jul 11 21:11:21.916390 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 562/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:21 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:22.933310 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-44c061b9-1c5f-40fc-b88b-cb43fb4a3415 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:22.933678 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-44c061b9-1c5f-40fc-b88b-cb43fb4a3415 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:22.935811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=2 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:22.936553 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:22.942889 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-44c061b9-1c5f-40fc-b88b-cb43fb4a3415 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:22.943334 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-44c061b9-1c5f-40fc-b88b-cb43fb4a3415 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:22.944261 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-44c061b9-1c5f-40fc-b88b-cb43fb4a3415 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:22.944558 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-44c061b9-1c5f-40fc-b88b-cb43fb4a3415 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:23.081177 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-44c061b9-1c5f-40fc-b88b-cb43fb4a3415 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:23.088774 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-44c061b9-1c5f-40fc-b88b-cb43fb4a3415 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.159560 Jul 11 21:11:23.089278 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 554/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:22 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:23.488338 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-fbe2c6f3-5b17-4d9b-b5a4-64e4acce5115 req-727cf91e-5a61-4671-b9e7-18feafce4de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf1bbec-8b13-42a5-aa9f-18029e20d2f4", "name": "network-vif-plugged", "status": "completed", "tag": "213eef57-1fc5-4f34-acc4-6258c35eb800"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:11:23.499227 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-fbe2c6f3-5b17-4d9b-b5a4-64e4acce5115 req-727cf91e-5a61-4671-b9e7-18feafce4de2 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:23.500804 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-fbe2c6f3-5b17-4d9b-b5a4-64e4acce5115 req-727cf91e-5a61-4671-b9e7-18feafce4de2 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:23.514417 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-fbe2c6f3-5b17-4d9b-b5a4-64e4acce5115 req-727cf91e-5a61-4671-b9e7-18feafce4de2 service nova] Creating event network-vif-plugged:213eef57-1fc5-4f34-acc4-6258c35eb800 for instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 on hv-cinder-84902 Jul 11 21:11:23.519772 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-fbe2c6f3-5b17-4d9b-b5a4-64e4acce5115 req-727cf91e-5a61-4671-b9e7-18feafce4de2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036614 Jul 11 21:11:23.520395 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 563/1117] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:11:24.106152 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0a6afc51-25bd-4804-b405-f5bcef7887fb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:24.107031 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0a6afc51-25bd-4804-b405-f5bcef7887fb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:24.114949 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0a6afc51-25bd-4804-b405-f5bcef7887fb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:24.115395 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0a6afc51-25bd-4804-b405-f5bcef7887fb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:24.116166 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0a6afc51-25bd-4804-b405-f5bcef7887fb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:24.116620 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0a6afc51-25bd-4804-b405-f5bcef7887fb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:24.252763 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0a6afc51-25bd-4804-b405-f5bcef7887fb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:24.260519 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0a6afc51-25bd-4804-b405-f5bcef7887fb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.158672 Jul 11 21:11:24.261123 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 555/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:24 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:25.283156 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-79769c87-2e63-4bc9-8f6c-f5a8cfb37a21 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:25.283814 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-79769c87-2e63-4bc9-8f6c-f5a8cfb37a21 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:25.291162 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-79769c87-2e63-4bc9-8f6c-f5a8cfb37a21 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:25.291594 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-79769c87-2e63-4bc9-8f6c-f5a8cfb37a21 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:25.292383 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-79769c87-2e63-4bc9-8f6c-f5a8cfb37a21 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:25.292818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-79769c87-2e63-4bc9-8f6c-f5a8cfb37a21 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:25.434335 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-79769c87-2e63-4bc9-8f6c-f5a8cfb37a21 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:25.442372 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-79769c87-2e63-4bc9-8f6c-f5a8cfb37a21 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1365 microversion: 2.1 time: 0.163500 Jul 11 21:11:25.442938 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 564/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:25 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:26.459217 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ed63bff5-2111-486f-93e1-e8a86e3fcd92 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:26.459945 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ed63bff5-2111-486f-93e1-e8a86e3fcd92 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:26.467476 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed63bff5-2111-486f-93e1-e8a86e3fcd92 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:26.467924 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed63bff5-2111-486f-93e1-e8a86e3fcd92 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:26.468727 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed63bff5-2111-486f-93e1-e8a86e3fcd92 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:26.469154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed63bff5-2111-486f-93e1-e8a86e3fcd92 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:26.610161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ed63bff5-2111-486f-93e1-e8a86e3fcd92 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:11:26.618508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ed63bff5-2111-486f-93e1-e8a86e3fcd92 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1555 microversion: 2.1 time: 0.163492 Jul 11 21:11:26.619070 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 556/1120] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:11:26 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:11:26.635679 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d93b2cb4-407b-4fd5-b0c8-7e68c1059364 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:11:26.636336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d93b2cb4-407b-4fd5-b0c8-7e68c1059364 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:11:26.642939 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d93b2cb4-407b-4fd5-b0c8-7e68c1059364 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:26.643391 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d93b2cb4-407b-4fd5-b0c8-7e68c1059364 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:26.644200 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d93b2cb4-407b-4fd5-b0c8-7e68c1059364 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:26.644635 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d93b2cb4-407b-4fd5-b0c8-7e68c1059364 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:26.661813 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:26.726693 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d93b2cb4-407b-4fd5-b0c8-7e68c1059364 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094978 Jul 11 21:11:26.727292 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 565/1121] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jul 11 21:11:26 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:11:27.833539 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-20a12189-30e1-4710-b7d1-096a854dc44d req-6b9c76f9-3fbf-42f8-80b7-03ca330b1635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf1bbec-8b13-42a5-aa9f-18029e20d2f4", "tag": "213eef57-1fc5-4f34-acc4-6258c35eb800"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:11:27.842942 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-20a12189-30e1-4710-b7d1-096a854dc44d req-6b9c76f9-3fbf-42f8-80b7-03ca330b1635 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:11:27.843410 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-20a12189-30e1-4710-b7d1-096a854dc44d req-6b9c76f9-3fbf-42f8-80b7-03ca330b1635 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:11:27.856629 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-20a12189-30e1-4710-b7d1-096a854dc44d req-6b9c76f9-3fbf-42f8-80b7-03ca330b1635 service nova] Creating event network-changed:213eef57-1fc5-4f34-acc4-6258c35eb800 for instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 on hv-cinder-84902 Jul 11 21:11:27.862050 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-20a12189-30e1-4710-b7d1-096a854dc44d req-6b9c76f9-3fbf-42f8-80b7-03ca330b1635 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161157 Jul 11 21:11:27.862694 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 557/1122] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:12:07.309920 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:07.315295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d25b56b0-cf7d-400e-a791-556f0b302377 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:12:07.315825 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d25b56b0-cf7d-400e-a791-556f0b302377 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:07.323119 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d25b56b0-cf7d-400e-a791-556f0b302377 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:07.323567 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d25b56b0-cf7d-400e-a791-556f0b302377 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:07.324362 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d25b56b0-cf7d-400e-a791-556f0b302377 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:07.324802 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d25b56b0-cf7d-400e-a791-556f0b302377 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:07.349628 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-d25b56b0-cf7d-400e-a791-556f0b302377 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lazy-loading 'flavor' on Instance uuid 4bea7e51-186a-4c52-a94a-9470dc903c21 {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:12:07.443708 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d25b56b0-cf7d-400e-a791-556f0b302377 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "POST /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21/action" status: 202 len: 0 microversion: 2.1 time: 0.136173 Jul 11 21:12:07.444307 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 566/1123] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:12:07 2022] POST /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:12:07.450830 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:07.451573 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:07.456528 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-71cee9c7-a9ad-4804-9fed-49588e6b1dd6 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:07.456662 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-71cee9c7-a9ad-4804-9fed-49588e6b1dd6 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:07.464562 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-71cee9c7-a9ad-4804-9fed-49588e6b1dd6 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:07.465039 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-71cee9c7-a9ad-4804-9fed-49588e6b1dd6 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:07.465790 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-71cee9c7-a9ad-4804-9fed-49588e6b1dd6 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:07.466252 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-71cee9c7-a9ad-4804-9fed-49588e6b1dd6 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:07.607659 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-71cee9c7-a9ad-4804-9fed-49588e6b1dd6 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:07.616210 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-71cee9c7-a9ad-4804-9fed-49588e6b1dd6 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.167119 Jul 11 21:12:07.616784 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 558/1124] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:07 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:08.639299 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-d4a515ac-218f-4a4d-afe4-edabcbeba775 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:08.640478 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-d4a515ac-218f-4a4d-afe4-edabcbeba775 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:08.648135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d4a515ac-218f-4a4d-afe4-edabcbeba775 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:08.648770 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d4a515ac-218f-4a4d-afe4-edabcbeba775 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:08.649534 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d4a515ac-218f-4a4d-afe4-edabcbeba775 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:08.649960 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-d4a515ac-218f-4a4d-afe4-edabcbeba775 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:08.793393 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-d4a515ac-218f-4a4d-afe4-edabcbeba775 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:08.801687 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-d4a515ac-218f-4a4d-afe4-edabcbeba775 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.169711 Jul 11 21:12:08.802302 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 567/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:08 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:09.823812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-8cb27096-a8d7-4cc9-9fcc-a5e244c64f5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:09.824776 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-8cb27096-a8d7-4cc9-9fcc-a5e244c64f5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:09.833297 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8cb27096-a8d7-4cc9-9fcc-a5e244c64f5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:09.833733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8cb27096-a8d7-4cc9-9fcc-a5e244c64f5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:09.834493 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8cb27096-a8d7-4cc9-9fcc-a5e244c64f5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:09.834892 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-8cb27096-a8d7-4cc9-9fcc-a5e244c64f5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:09.988329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-8cb27096-a8d7-4cc9-9fcc-a5e244c64f5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:10.001039 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-8cb27096-a8d7-4cc9-9fcc-a5e244c64f5e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.183526 Jul 11 21:12:10.001931 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 559/1126] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:09 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:11.025654 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e4927f29-ed55-4d63-9a0f-6f193ce26b5b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:11.026275 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e4927f29-ed55-4d63-9a0f-6f193ce26b5b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:11.034213 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e4927f29-ed55-4d63-9a0f-6f193ce26b5b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:11.034664 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e4927f29-ed55-4d63-9a0f-6f193ce26b5b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:11.035433 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e4927f29-ed55-4d63-9a0f-6f193ce26b5b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:11.035863 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e4927f29-ed55-4d63-9a0f-6f193ce26b5b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:11.187985 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e4927f29-ed55-4d63-9a0f-6f193ce26b5b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:11.195732 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e4927f29-ed55-4d63-9a0f-6f193ce26b5b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.174865 Jul 11 21:12:11.196333 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 568/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:11 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:12.218307 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-56197d22-6bd8-4b5d-863b-8798abfd915e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:12.219372 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-56197d22-6bd8-4b5d-863b-8798abfd915e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:12.230316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-56197d22-6bd8-4b5d-863b-8798abfd915e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:12.231053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-56197d22-6bd8-4b5d-863b-8798abfd915e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:12.232359 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-56197d22-6bd8-4b5d-863b-8798abfd915e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:12.233120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-56197d22-6bd8-4b5d-863b-8798abfd915e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:12.380763 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-56197d22-6bd8-4b5d-863b-8798abfd915e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:12.389090 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-56197d22-6bd8-4b5d-863b-8798abfd915e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.177501 Jul 11 21:12:12.389640 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 560/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:12 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:13.409022 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0c5146ae-774a-4fdb-8c97-885eeffe820b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:13.409726 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0c5146ae-774a-4fdb-8c97-885eeffe820b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:13.417012 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0c5146ae-774a-4fdb-8c97-885eeffe820b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:13.417672 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0c5146ae-774a-4fdb-8c97-885eeffe820b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:13.418321 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0c5146ae-774a-4fdb-8c97-885eeffe820b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:13.418864 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0c5146ae-774a-4fdb-8c97-885eeffe820b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:13.559188 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-0c5146ae-774a-4fdb-8c97-885eeffe820b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:13.570540 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0c5146ae-774a-4fdb-8c97-885eeffe820b tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.166668 Jul 11 21:12:13.571293 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 569/1129] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:13 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:14.594737 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-de3ba0bc-4b26-43f0-9562-3ad96ac75e41 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:14.595390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-de3ba0bc-4b26-43f0-9562-3ad96ac75e41 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:14.605604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-de3ba0bc-4b26-43f0-9562-3ad96ac75e41 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:14.606230 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-de3ba0bc-4b26-43f0-9562-3ad96ac75e41 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:14.607388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-de3ba0bc-4b26-43f0-9562-3ad96ac75e41 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:14.607988 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-de3ba0bc-4b26-43f0-9562-3ad96ac75e41 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:14.750727 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-de3ba0bc-4b26-43f0-9562-3ad96ac75e41 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:14.759124 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-de3ba0bc-4b26-43f0-9562-3ad96ac75e41 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.170805 Jul 11 21:12:14.759698 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 561/1130] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:14 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:15.781533 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-68ad30e4-0b81-461e-b6cb-5f561682b64a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:15.782665 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-68ad30e4-0b81-461e-b6cb-5f561682b64a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:15.793631 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68ad30e4-0b81-461e-b6cb-5f561682b64a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:15.794370 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68ad30e4-0b81-461e-b6cb-5f561682b64a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:15.795625 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68ad30e4-0b81-461e-b6cb-5f561682b64a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:15.796410 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-68ad30e4-0b81-461e-b6cb-5f561682b64a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:15.938683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-68ad30e4-0b81-461e-b6cb-5f561682b64a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:15.950581 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-68ad30e4-0b81-461e-b6cb-5f561682b64a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.175838 Jul 11 21:12:15.951417 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 570/1131] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:15 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:16.969926 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ffdcd90b-564d-46d4-9a76-229c8af1f3de tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:16.970590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ffdcd90b-564d-46d4-9a76-229c8af1f3de tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:16.977870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ffdcd90b-564d-46d4-9a76-229c8af1f3de tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:16.978318 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ffdcd90b-564d-46d4-9a76-229c8af1f3de tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:16.979084 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ffdcd90b-564d-46d4-9a76-229c8af1f3de tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:16.979516 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ffdcd90b-564d-46d4-9a76-229c8af1f3de tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:17.130566 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ffdcd90b-564d-46d4-9a76-229c8af1f3de tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:17.142483 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ffdcd90b-564d-46d4-9a76-229c8af1f3de tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.176931 Jul 11 21:12:17.143189 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 562/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:16 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:18.160149 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a358ebb4-9ec0-4958-8995-e0ae28835d58 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:18.160753 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a358ebb4-9ec0-4958-8995-e0ae28835d58 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:18.167489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a358ebb4-9ec0-4958-8995-e0ae28835d58 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:18.167937 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a358ebb4-9ec0-4958-8995-e0ae28835d58 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:18.168742 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a358ebb4-9ec0-4958-8995-e0ae28835d58 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:18.169165 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a358ebb4-9ec0-4958-8995-e0ae28835d58 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:18.300753 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a358ebb4-9ec0-4958-8995-e0ae28835d58 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:18.308509 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a358ebb4-9ec0-4958-8995-e0ae28835d58 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.152281 Jul 11 21:12:18.309096 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 571/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:18 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:19.329142 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-37b80269-4929-4da0-a1bc-3330cf61c762 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:19.330094 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-37b80269-4929-4da0-a1bc-3330cf61c762 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:19.340633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-37b80269-4929-4da0-a1bc-3330cf61c762 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:19.341274 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-37b80269-4929-4da0-a1bc-3330cf61c762 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:19.342518 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-37b80269-4929-4da0-a1bc-3330cf61c762 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:19.343154 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-37b80269-4929-4da0-a1bc-3330cf61c762 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:19.481037 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-37b80269-4929-4da0-a1bc-3330cf61c762 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:19.490290 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-37b80269-4929-4da0-a1bc-3330cf61c762 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.167589 Jul 11 21:12:19.490870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 563/1134] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:19 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:20.507173 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1bd8d2f3-879b-491f-98a4-c6e964d408cd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:20.507776 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1bd8d2f3-879b-491f-98a4-c6e964d408cd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:20.514675 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1bd8d2f3-879b-491f-98a4-c6e964d408cd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:20.515141 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1bd8d2f3-879b-491f-98a4-c6e964d408cd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:20.515896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1bd8d2f3-879b-491f-98a4-c6e964d408cd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:20.516361 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1bd8d2f3-879b-491f-98a4-c6e964d408cd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:20.834469 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-1bd8d2f3-879b-491f-98a4-c6e964d408cd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:20.845263 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1bd8d2f3-879b-491f-98a4-c6e964d408cd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1570 microversion: 2.1 time: 0.341894 Jul 11 21:12:20.846112 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 572/1135] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:20 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1570 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:20.862484 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-11393afe-54dc-44a5-8a94-111d94c658b7 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:12:20.863010 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-11393afe-54dc-44a5-8a94-111d94c658b7 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:20.869633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11393afe-54dc-44a5-8a94-111d94c658b7 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:20.870074 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11393afe-54dc-44a5-8a94-111d94c658b7 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:20.870824 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11393afe-54dc-44a5-8a94-111d94c658b7 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:20.871247 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-11393afe-54dc-44a5-8a94-111d94c658b7 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:20.967528 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-11393afe-54dc-44a5-8a94-111d94c658b7 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "POST /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21/action" status: 202 len: 0 microversion: 2.1 time: 0.108994 Jul 11 21:12:20.968310 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 564/1136] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jul 11 21:12:20 2022] POST /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:12:20.977055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e822ab9d-67eb-4008-bb8a-ad7e0c9944bd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:20.977753 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e822ab9d-67eb-4008-bb8a-ad7e0c9944bd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:20.984202 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e822ab9d-67eb-4008-bb8a-ad7e0c9944bd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:20.984716 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e822ab9d-67eb-4008-bb8a-ad7e0c9944bd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:20.985553 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e822ab9d-67eb-4008-bb8a-ad7e0c9944bd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:20.985995 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e822ab9d-67eb-4008-bb8a-ad7e0c9944bd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:21.152386 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e822ab9d-67eb-4008-bb8a-ad7e0c9944bd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:21.160480 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e822ab9d-67eb-4008-bb8a-ad7e0c9944bd tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1518 microversion: 2.1 time: 0.187731 Jul 11 21:12:21.161074 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 573/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:20 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:22.179767 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-d0dba039-8d3d-4972-8cef-7925522651b9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:22.180401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-d0dba039-8d3d-4972-8cef-7925522651b9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:22.187914 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d0dba039-8d3d-4972-8cef-7925522651b9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:22.188385 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d0dba039-8d3d-4972-8cef-7925522651b9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:22.189156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d0dba039-8d3d-4972-8cef-7925522651b9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:22.189591 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-d0dba039-8d3d-4972-8cef-7925522651b9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:22.377930 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-d0dba039-8d3d-4972-8cef-7925522651b9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:22.386063 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-d0dba039-8d3d-4972-8cef-7925522651b9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1520 microversion: 2.1 time: 0.211135 Jul 11 21:12:22.386608 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 565/1138] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:22 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:23.403760 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a17ed9ca-590b-41b0-bb3f-76168a5abbb0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:23.404422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a17ed9ca-590b-41b0-bb3f-76168a5abbb0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:23.411283 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a17ed9ca-590b-41b0-bb3f-76168a5abbb0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:23.411726 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a17ed9ca-590b-41b0-bb3f-76168a5abbb0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:23.412933 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a17ed9ca-590b-41b0-bb3f-76168a5abbb0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:23.413100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a17ed9ca-590b-41b0-bb3f-76168a5abbb0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:23.576345 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a17ed9ca-590b-41b0-bb3f-76168a5abbb0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:23.584000 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a17ed9ca-590b-41b0-bb3f-76168a5abbb0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1576 microversion: 2.1 time: 0.184165 Jul 11 21:12:23.584613 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 574/1139] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:23 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:23.777840 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-cd0e6d34-bf3b-41e4-b4f3-a8579f3f1c31 req-b0ac2ee9-b51e-4110-9476-e2408f60cd6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bea7e51-186a-4c52-a94a-9470dc903c21", "name": "network-vif-unplugged", "status": "completed", "tag": "e0b24542-e2ec-4ba9-8dad-b15749bd5e76"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:12:23.789196 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-cd0e6d34-bf3b-41e4-b4f3-a8579f3f1c31 req-b0ac2ee9-b51e-4110-9476-e2408f60cd6c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:23.789873 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-cd0e6d34-bf3b-41e4-b4f3-a8579f3f1c31 req-b0ac2ee9-b51e-4110-9476-e2408f60cd6c service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:23.801932 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-cd0e6d34-bf3b-41e4-b4f3-a8579f3f1c31 req-b0ac2ee9-b51e-4110-9476-e2408f60cd6c service nova] Creating event network-vif-unplugged:e0b24542-e2ec-4ba9-8dad-b15749bd5e76 for instance 4bea7e51-186a-4c52-a94a-9470dc903c21 on hv-cinder-84902 Jul 11 21:12:23.810412 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-cd0e6d34-bf3b-41e4-b4f3-a8579f3f1c31 req-b0ac2ee9-b51e-4110-9476-e2408f60cd6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036564 Jul 11 21:12:23.811012 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 566/1140] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:12:24.611063 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ac596d64-a391-4356-92a7-3c1623b3ca03 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:24.612006 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ac596d64-a391-4356-92a7-3c1623b3ca03 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:24.621115 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ac596d64-a391-4356-92a7-3c1623b3ca03 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:24.621558 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ac596d64-a391-4356-92a7-3c1623b3ca03 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:24.622341 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ac596d64-a391-4356-92a7-3c1623b3ca03 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:24.622766 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ac596d64-a391-4356-92a7-3c1623b3ca03 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:24.756228 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ac596d64-a391-4356-92a7-3c1623b3ca03 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:24.764422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ac596d64-a391-4356-92a7-3c1623b3ca03 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1576 microversion: 2.1 time: 0.159984 Jul 11 21:12:24.764987 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 575/1141] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:24 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:25.787532 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0d83bd5d-09d9-40b2-a475-74bff0c1a334 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:25.788627 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0d83bd5d-09d9-40b2-a475-74bff0c1a334 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:25.796370 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0d83bd5d-09d9-40b2-a475-74bff0c1a334 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:25.797166 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0d83bd5d-09d9-40b2-a475-74bff0c1a334 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:25.797920 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0d83bd5d-09d9-40b2-a475-74bff0c1a334 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:25.798344 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0d83bd5d-09d9-40b2-a475-74bff0c1a334 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:25.935153 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0d83bd5d-09d9-40b2-a475-74bff0c1a334 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:25.943280 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0d83bd5d-09d9-40b2-a475-74bff0c1a334 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1576 microversion: 2.1 time: 0.163817 Jul 11 21:12:25.943861 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 567/1142] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:25 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:26.964526 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6d049601-8cd4-44d6-88e3-36df4cd4e98e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:26.965194 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6d049601-8cd4-44d6-88e3-36df4cd4e98e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:26.973071 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d049601-8cd4-44d6-88e3-36df4cd4e98e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:26.973490 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d049601-8cd4-44d6-88e3-36df4cd4e98e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:26.974320 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d049601-8cd4-44d6-88e3-36df4cd4e98e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:26.974795 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6d049601-8cd4-44d6-88e3-36df4cd4e98e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:27.120734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6d049601-8cd4-44d6-88e3-36df4cd4e98e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:27.128497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6d049601-8cd4-44d6-88e3-36df4cd4e98e tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1576 microversion: 2.1 time: 0.169638 Jul 11 21:12:27.129076 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 576/1143] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:26 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:28.155688 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-6c372ef6-360e-4360-92e3-3b2bc0858665 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:28.156756 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-6c372ef6-360e-4360-92e3-3b2bc0858665 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:28.166963 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c372ef6-360e-4360-92e3-3b2bc0858665 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:28.167401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c372ef6-360e-4360-92e3-3b2bc0858665 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:28.168189 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c372ef6-360e-4360-92e3-3b2bc0858665 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:28.168611 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-6c372ef6-360e-4360-92e3-3b2bc0858665 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:28.315085 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-6c372ef6-360e-4360-92e3-3b2bc0858665 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:28.323025 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-6c372ef6-360e-4360-92e3-3b2bc0858665 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1576 microversion: 2.1 time: 0.174103 Jul 11 21:12:28.323590 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 568/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:28 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:29.342290 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e68007d4-d1f1-45ec-8c21-8a61f852393f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:29.343016 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-e68007d4-d1f1-45ec-8c21-8a61f852393f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:29.350762 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e68007d4-d1f1-45ec-8c21-8a61f852393f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:29.351256 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e68007d4-d1f1-45ec-8c21-8a61f852393f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:29.352095 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e68007d4-d1f1-45ec-8c21-8a61f852393f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:29.352617 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-e68007d4-d1f1-45ec-8c21-8a61f852393f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:29.492781 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-e68007d4-d1f1-45ec-8c21-8a61f852393f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:29.504781 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e68007d4-d1f1-45ec-8c21-8a61f852393f tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1576 microversion: 2.1 time: 0.166462 Jul 11 21:12:29.505577 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 577/1145] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:29 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:30.526125 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-0b2ec0d8-4b61-4e70-8df0-5951fe560f02 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:30.526749 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-0b2ec0d8-4b61-4e70-8df0-5951fe560f02 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:30.535051 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0b2ec0d8-4b61-4e70-8df0-5951fe560f02 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:30.535492 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0b2ec0d8-4b61-4e70-8df0-5951fe560f02 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:30.536303 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0b2ec0d8-4b61-4e70-8df0-5951fe560f02 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:30.536731 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-0b2ec0d8-4b61-4e70-8df0-5951fe560f02 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:30.714300 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-0b2ec0d8-4b61-4e70-8df0-5951fe560f02 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:30.722202 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-0b2ec0d8-4b61-4e70-8df0-5951fe560f02 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1576 microversion: 2.1 time: 0.203034 Jul 11 21:12:30.722773 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 569/1146] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:30 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:31.740398 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2a275004-4ce6-4f34-b94f-86cb421ba428 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:31.741002 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2a275004-4ce6-4f34-b94f-86cb421ba428 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:31.747816 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a275004-4ce6-4f34-b94f-86cb421ba428 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:31.748297 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a275004-4ce6-4f34-b94f-86cb421ba428 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:31.749061 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a275004-4ce6-4f34-b94f-86cb421ba428 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:31.749490 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2a275004-4ce6-4f34-b94f-86cb421ba428 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:31.883190 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-2a275004-4ce6-4f34-b94f-86cb421ba428 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:31.892273 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2a275004-4ce6-4f34-b94f-86cb421ba428 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1576 microversion: 2.1 time: 0.155847 Jul 11 21:12:31.897448 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 578/1147] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:31 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:32.916532 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9f436775-d31c-48a8-8f26-13b78fbaf3ac tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:32.917791 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-9f436775-d31c-48a8-8f26-13b78fbaf3ac tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:32.929578 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9f436775-d31c-48a8-8f26-13b78fbaf3ac tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:32.930320 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9f436775-d31c-48a8-8f26-13b78fbaf3ac tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:32.931626 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9f436775-d31c-48a8-8f26-13b78fbaf3ac tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:32.932371 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-9f436775-d31c-48a8-8f26-13b78fbaf3ac tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:33.084098 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-9f436775-d31c-48a8-8f26-13b78fbaf3ac tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:33.092137 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9f436775-d31c-48a8-8f26-13b78fbaf3ac tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1563 microversion: 2.1 time: 0.182376 Jul 11 21:12:33.092754 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 570/1148] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:32 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:33.853623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-175266f5-fac6-48e5-afb9-e77cb25176fc req-5ce206cf-b45a-4796-95e8-33adcadf4b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bea7e51-186a-4c52-a94a-9470dc903c21", "name": "network-vif-plugged", "status": "completed", "tag": "e0b24542-e2ec-4ba9-8dad-b15749bd5e76"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:12:33.863100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-175266f5-fac6-48e5-afb9-e77cb25176fc req-5ce206cf-b45a-4796-95e8-33adcadf4b9b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:33.863539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-175266f5-fac6-48e5-afb9-e77cb25176fc req-5ce206cf-b45a-4796-95e8-33adcadf4b9b service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:33.874990 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-175266f5-fac6-48e5-afb9-e77cb25176fc req-5ce206cf-b45a-4796-95e8-33adcadf4b9b service nova] Creating event network-vif-plugged:e0b24542-e2ec-4ba9-8dad-b15749bd5e76 for instance 4bea7e51-186a-4c52-a94a-9470dc903c21 on hv-cinder-84902 Jul 11 21:12:33.879878 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-175266f5-fac6-48e5-afb9-e77cb25176fc req-5ce206cf-b45a-4796-95e8-33adcadf4b9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030165 Jul 11 21:12:33.880671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 579/1149] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:12:42.830914 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-90eb3d6e-d90e-428a-9555-06ffc0bb7ccb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:42.831802 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-90eb3d6e-d90e-428a-9555-06ffc0bb7ccb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:42.835862 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=29 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:42.843902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90eb3d6e-d90e-428a-9555-06ffc0bb7ccb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:42.844400 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90eb3d6e-d90e-428a-9555-06ffc0bb7ccb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:42.845138 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90eb3d6e-d90e-428a-9555-06ffc0bb7ccb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:42.845561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-90eb3d6e-d90e-428a-9555-06ffc0bb7ccb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:42.848144 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:42.876136 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-90eb3d6e-d90e-428a-9555-06ffc0bb7ccb tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/ips" status: 200 len: 150 microversion: 2.1 time: 0.051430 Jul 11 21:12:42.876851 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 571/1150] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 21:12:42 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:12:44.221134 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=28 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:44.221888 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:44.226680 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-bf5e9d49-612a-4527-9bc0-c0c8d9ef7601 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49769ec6-bd19-4140-89b3-24c27854a172"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:12:44.228011 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-bf5e9d49-612a-4527-9bc0-c0c8d9ef7601 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:44.235858 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bf5e9d49-612a-4527-9bc0-c0c8d9ef7601 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:44.236338 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bf5e9d49-612a-4527-9bc0-c0c8d9ef7601 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:44.237100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bf5e9d49-612a-4527-9bc0-c0c8d9ef7601 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:44.237532 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-bf5e9d49-612a-4527-9bc0-c0c8d9ef7601 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:44.512467 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-bf5e9d49-612a-4527-9bc0-c0c8d9ef7601 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292647 Jul 11 21:12:44.513267 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 580/1151] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:12:44 2022] POST /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:12:52.060529 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49769ec6-bd19-4140-89b3-24c27854a172"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:12:52.062394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:52.072700 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:52.073402 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:52.074578 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:52.075207 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:52.156705 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Invalid volume: volume 49769ec6-bd19-4140-89b3-24c27854a172 is already attached to instances: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: POST /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments HTTP/1.1 Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 74 Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:12:52.158423 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {"volumeAttachment": {"volumeId": "49769ec6-bd19-4140-89b3-24c27854a172"}} Jul 11 21:12:52.160161 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Invalid volume: volume 49769ec6-bd19-4140-89b3-24c27854a172 is already attached to instances: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'server_id': '8bf1bbec-8b13-42a5-aa9f-18029e20d2f4', 'body': {'volumeAttachment': {'volumeId': '49769ec6-bd19-4140-89b3-24c27854a172'}}} Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 49769ec6-bd19-4140-89b3-24c27854a172 is already attached to instances: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:52.161292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 49769ec6-bd19-4140-89b3-24c27854a172 is already attached to instances: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:12:52.162866 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:12:52.164559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:12:52.164559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:12:52.164559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:12:52.164559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 49769ec6-bd19-4140-89b3-24c27854a172 is already attached to instances: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 Jul 11 21:12:52.164559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:52.164559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 400 to user: Invalid volume: volume 49769ec6-bd19-4140-89b3-24c27854a172 is already attached to instances: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:12:52.164559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-813688cf-33ca-4619-a163-8a40ca625641 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106090 Jul 11 21:12:52.164559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 572/1152] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:12:52 2022] POST /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 21:12:52.221018 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-978b97a2-8008-4aab-835e-fb18bf6b1ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:52.221601 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-978b97a2-8008-4aab-835e-fb18bf6b1ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:52.227926 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-978b97a2-8008-4aab-835e-fb18bf6b1ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:52.228415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-978b97a2-8008-4aab-835e-fb18bf6b1ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:52.229178 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-978b97a2-8008-4aab-835e-fb18bf6b1ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:52.229612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-978b97a2-8008-4aab-835e-fb18bf6b1ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:52.313170 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-978b97a2-8008-4aab-835e-fb18bf6b1ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lazy-loading 'services' on Instance uuid 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:12:52.392019 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-978b97a2-8008-4aab-835e-fb18bf6b1ffc tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments/49769ec6-bd19-4140-89b3-24c27854a172" status: 202 len: 0 microversion: 2.1 time: 0.175312 Jul 11 21:12:52.392647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 581/1153] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:12:52 2022] DELETE /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments/49769ec6-bd19-4140-89b3-24c27854a172 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:12:52.402112 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-efc15fc6-4ce2-40c3-8cb6-9c4932b3c9a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:52.403024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-efc15fc6-4ce2-40c3-8cb6-9c4932b3c9a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:52.409832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-efc15fc6-4ce2-40c3-8cb6-9c4932b3c9a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:52.410394 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-efc15fc6-4ce2-40c3-8cb6-9c4932b3c9a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:52.411185 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-efc15fc6-4ce2-40c3-8cb6-9c4932b3c9a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:52.411666 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-efc15fc6-4ce2-40c3-8cb6-9c4932b3c9a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:52.444793 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-efc15fc6-4ce2-40c3-8cb6-9c4932b3c9a6 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046963 Jul 11 21:12:52.445347 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 573/1154] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:12:52 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:12:53.457992 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-35190d68-bb35-45cc-8fd4-01f28c43dece tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:53.459241 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-35190d68-bb35-45cc-8fd4-01f28c43dece tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:53.467212 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-35190d68-bb35-45cc-8fd4-01f28c43dece tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:53.467659 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-35190d68-bb35-45cc-8fd4-01f28c43dece tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:53.468475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-35190d68-bb35-45cc-8fd4-01f28c43dece tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:53.468907 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-35190d68-bb35-45cc-8fd4-01f28c43dece tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:53.501016 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-35190d68-bb35-45cc-8fd4-01f28c43dece tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048066 Jul 11 21:12:53.501611 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 582/1155] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:12:53 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 21:12:53.560650 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-660eaff3-7eaf-473b-b803-e731886b935c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:53.561207 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-660eaff3-7eaf-473b-b803-e731886b935c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:53.568147 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-660eaff3-7eaf-473b-b803-e731886b935c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:53.568604 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-660eaff3-7eaf-473b-b803-e731886b935c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:53.569352 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-660eaff3-7eaf-473b-b803-e731886b935c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:53.569780 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-660eaff3-7eaf-473b-b803-e731886b935c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:53.594748 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-660eaff3-7eaf-473b-b803-e731886b935c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:12:53.677186 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-660eaff3-7eaf-473b-b803-e731886b935c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 204 len: 0 microversion: 2.1 time: 0.118806 Jul 11 21:12:53.677186 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 574/1156] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:12:53 2022] DELETE /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:12:53.685373 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-74ef3246-4174-4d16-a361-8e1a695a241c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:53.686044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-74ef3246-4174-4d16-a361-8e1a695a241c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:53.692770 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74ef3246-4174-4d16-a361-8e1a695a241c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:53.693218 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74ef3246-4174-4d16-a361-8e1a695a241c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:53.693979 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74ef3246-4174-4d16-a361-8e1a695a241c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:53.694409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-74ef3246-4174-4d16-a361-8e1a695a241c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:53.839379 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-74ef3246-4174-4d16-a361-8e1a695a241c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:53.847350 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-74ef3246-4174-4d16-a361-8e1a695a241c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1680 microversion: 2.1 time: 0.166181 Jul 11 21:12:53.847953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 583/1157] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:53 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:54.866069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ee7396fa-eb4b-4682-9322-16d6b8af48b1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:54.866800 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ee7396fa-eb4b-4682-9322-16d6b8af48b1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:54.874059 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee7396fa-eb4b-4682-9322-16d6b8af48b1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:54.874534 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee7396fa-eb4b-4682-9322-16d6b8af48b1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:54.875327 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee7396fa-eb4b-4682-9322-16d6b8af48b1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:54.875783 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee7396fa-eb4b-4682-9322-16d6b8af48b1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:55.017945 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ee7396fa-eb4b-4682-9322-16d6b8af48b1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:55.026216 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ee7396fa-eb4b-4682-9322-16d6b8af48b1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1680 microversion: 2.1 time: 0.164827 Jul 11 21:12:55.026796 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 575/1158] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:54 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:56.048166 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6bea4f49-751c-4b36-9b77-87b55a3d5695 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:56.048891 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6bea4f49-751c-4b36-9b77-87b55a3d5695 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:56.058236 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6bea4f49-751c-4b36-9b77-87b55a3d5695 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:56.058681 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6bea4f49-751c-4b36-9b77-87b55a3d5695 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:56.059446 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6bea4f49-751c-4b36-9b77-87b55a3d5695 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:56.059873 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6bea4f49-751c-4b36-9b77-87b55a3d5695 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:56.198298 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-6bea4f49-751c-4b36-9b77-87b55a3d5695 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:56.206059 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6bea4f49-751c-4b36-9b77-87b55a3d5695 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1680 microversion: 2.1 time: 0.166111 Jul 11 21:12:56.206612 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 584/1159] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:56 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:57.053375 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-f8251ef5-48f0-4bf5-95ed-a6750095998a req-13a6c358-f023-442d-b2f3-32e1d5b1be0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf1bbec-8b13-42a5-aa9f-18029e20d2f4", "name": "network-vif-deleted", "tag": "213eef57-1fc5-4f34-acc4-6258c35eb800"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:12:57.063843 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-f8251ef5-48f0-4bf5-95ed-a6750095998a req-13a6c358-f023-442d-b2f3-32e1d5b1be0e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:57.064269 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-f8251ef5-48f0-4bf5-95ed-a6750095998a req-13a6c358-f023-442d-b2f3-32e1d5b1be0e service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:57.076296 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-f8251ef5-48f0-4bf5-95ed-a6750095998a req-13a6c358-f023-442d-b2f3-32e1d5b1be0e service nova] Creating event network-vif-deleted:213eef57-1fc5-4f34-acc4-6258c35eb800 for instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 on hv-cinder-84902 Jul 11 21:12:57.081365 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-f8251ef5-48f0-4bf5-95ed-a6750095998a req-13a6c358-f023-442d-b2f3-32e1d5b1be0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031709 Jul 11 21:12:57.082212 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 576/1160] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:12:57.223720 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:57.224363 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:57.230880 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:57.231333 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:57.232095 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:57.232564 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:57.263656 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:57.263936 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:57.264661 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.objects.instance [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lazy-loading 'fault' on Instance uuid 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 {{(pid=118013) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:12:57.304934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:12:57.312497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b4e392dd-caca-4c02-ae99-e01995538d82 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 200 len: 1329 microversion: 2.1 time: 0.092754 Jul 11 21:12:57.313053 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 585/1161] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:57 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:12:58.335129 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:58.335915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:12:58.346281 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:58.347095 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:58.347884 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:12:58.348366 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:12:58.363094 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 HTTP/1.1 Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:12:58.365806 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:12:58.367605 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '8bf1bbec-8b13-42a5-aa9f-18029e20d2f4'} Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:12:58.368428 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:12:58.369695 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:12:58.370875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:12:58.370875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-cf1f4657-8d67-47a3-a390-3b6852aa3e99 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 404 len: 111 microversion: 2.1 time: 0.040526 Jul 11 21:12:58.370875 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 577/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:12:58 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:12:58.377103 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-5ed7fbb5-dcc1-4976-a649-cb2147a63685 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '.version_select at 0x7f3840f5ddc0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:12:58.396826 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-5ed7fbb5-dcc1-4976-a649-cb2147a63685 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-44123784" status: 202 len: 0 microversion: 2.1 time: 0.023747 Jul 11 21:12:58.397401 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 586/1163] 10.222.0.20 () {58 vars in 1214 bytes} [Mon Jul 11 21:12:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-44123784 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:12:59.050157 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c2801679-4abe-4623-b473-4a94a56719a7 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: .version_select at 0x7f384055af70>, body: {"keypair": {"name": "tempest-keypair-848477452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5VlxpKkB19xSFxDj6qIow7p5FtHFiv94RFY7s9MsNzyWrNrdgtvgQEPHAISSWlbuCOQ5dsJ+TTE4jIab7jjitkTTPkHAWBM8eFz8V2PsW+rlRVT801MkFbIu+Pi6rVbw=="}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:12:59.064456 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-c2801679-4abe-4623-b473-4a94a56719a7 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:12:59.068688 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.quota [None req-c2801679-4abe-4623-b473-4a94a56719a7 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for user 68f6997db7c141529c37cc64955df779 and project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'key_pairs'} {{(pid=118014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:12:59.093861 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c2801679-4abe-4623-b473-4a94a56719a7 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048074 Jul 11 21:12:59.094386 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 578/1164] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jul 11 21:12:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:13:00.640556 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1232397637", "imageRef": "611d0f46-46fc-46b1-8858-0fdb9f16ae36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "681ae82c-3a6d-44f5-9bef-155f92884bde"}], "security_groups": [{"name": "tempest-securitygroup--757211311"}], "key_name": "tempest-keypair-848477452", "user_data": "}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:13:00.757457 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.network.neutron [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] validate_networks() for [('681ae82c-3a6d-44f5-9bef-155f92884bde', None, None, None, None, None)] {{(pid=118013) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 21:13:01.223299 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Flavor limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 21:13:01.223719 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Image limits 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 21:13:01.224220 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Flavor pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 21:13:01.224624 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Image pref 0:0:0 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 21:13:01.225029 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.virt.hardware [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118013) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 21:13:01.234906 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:01.235415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:01.236249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:01.236700 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:01.253675 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 21:13:01.257739 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.quota [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Getting quotas for user 68f6997db7c141529c37cc64955df779 and project b85a8791815f40f98ed1e81e58b01fd6. Resources: {'ram', 'cores', 'instances'} {{(pid=118013) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 21:13:01.269646 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Going to run 1 instances... {{(pid=118013) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 21:13:01.271925 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611d0f46-46fc-46b1-8858-0fdb9f16ae36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118013) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 21:13:01.322460 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-9cbd6fbf-8faa-4220-862b-e4862cdb1c79 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.686825 Jul 11 21:13:01.323139 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 587/1165] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jul 11 21:13:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 21:13:01.333955 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-dccacfe1-e6ea-47a1-ac2e-233d52d6db34 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:01.334547 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-dccacfe1-e6ea-47a1-ac2e-233d52d6db34 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:01.389758 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-dccacfe1-e6ea-47a1-ac2e-233d52d6db34 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:01.396642 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-dccacfe1-e6ea-47a1-ac2e-233d52d6db34 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1241 microversion: 2.1 time: 0.067185 Jul 11 21:13:01.397213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 579/1166] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:01 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:02.413863 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ab3957b3-1f8c-4cd0-a83f-67bb54d7786e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:02.415236 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-ab3957b3-1f8c-4cd0-a83f-67bb54d7786e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:02.422492 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ab3957b3-1f8c-4cd0-a83f-67bb54d7786e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:02.423167 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ab3957b3-1f8c-4cd0-a83f-67bb54d7786e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:02.424902 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ab3957b3-1f8c-4cd0-a83f-67bb54d7786e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:02.425452 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-ab3957b3-1f8c-4cd0-a83f-67bb54d7786e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:02.491765 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-ab3957b3-1f8c-4cd0-a83f-67bb54d7786e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:02.501538 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ab3957b3-1f8c-4cd0-a83f-67bb54d7786e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1311 microversion: 2.1 time: 0.092013 Jul 11 21:13:02.503894 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 588/1167] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:02 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:03.520944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-e9115aef-44d0-4827-9f04-b347beb242ef tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:03.521638 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-e9115aef-44d0-4827-9f04-b347beb242ef tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:03.530539 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e9115aef-44d0-4827-9f04-b347beb242ef tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:03.530922 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e9115aef-44d0-4827-9f04-b347beb242ef tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:03.532075 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e9115aef-44d0-4827-9f04-b347beb242ef tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:03.532717 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-e9115aef-44d0-4827-9f04-b347beb242ef tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:03.786408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-e9115aef-44d0-4827-9f04-b347beb242ef tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:03.794723 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-e9115aef-44d0-4827-9f04-b347beb242ef tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1366 microversion: 2.1 time: 0.278168 Jul 11 21:13:03.795593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 580/1168] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:03 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:03.953028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-adf2cde4-63ad-4265-80fb-37d509edc797 req-1f4e4131-dbd1-4fb8-afe6-8d11650855c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c42a450-8df4-41fa-90e9-7a630bcacb0c", "tag": "ac2aa586-139e-436c-a2e3-6e292448d83c"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:13:03.969744 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-adf2cde4-63ad-4265-80fb-37d509edc797 req-1f4e4131-dbd1-4fb8-afe6-8d11650855c0 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:03.970119 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-adf2cde4-63ad-4265-80fb-37d509edc797 req-1f4e4131-dbd1-4fb8-afe6-8d11650855c0 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:03.990123 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-adf2cde4-63ad-4265-80fb-37d509edc797 req-1f4e4131-dbd1-4fb8-afe6-8d11650855c0 service nova] Creating event network-changed:ac2aa586-139e-436c-a2e3-6e292448d83c for instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c on hv-cinder-84902 Jul 11 21:13:03.995071 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-adf2cde4-63ad-4265-80fb-37d509edc797 req-1f4e4131-dbd1-4fb8-afe6-8d11650855c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047156 Jul 11 21:13:03.996287 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 589/1169] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:13:04.816704 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ee7e5a2e-bd3b-47e9-b02d-56106f1d3acd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:04.821329 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ee7e5a2e-bd3b-47e9-b02d-56106f1d3acd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:04.828894 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee7e5a2e-bd3b-47e9-b02d-56106f1d3acd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:04.829731 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee7e5a2e-bd3b-47e9-b02d-56106f1d3acd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:04.831122 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee7e5a2e-bd3b-47e9-b02d-56106f1d3acd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:04.831496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ee7e5a2e-bd3b-47e9-b02d-56106f1d3acd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:04.978171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ee7e5a2e-bd3b-47e9-b02d-56106f1d3acd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:04.985991 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ee7e5a2e-bd3b-47e9-b02d-56106f1d3acd tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1366 microversion: 2.1 time: 0.175831 Jul 11 21:13:04.986559 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 581/1170] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:04 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:06.009434 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-44b74014-a772-469a-b6ec-3e0307dad47c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:06.010564 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-44b74014-a772-469a-b6ec-3e0307dad47c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:06.020251 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-44b74014-a772-469a-b6ec-3e0307dad47c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:06.020697 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-44b74014-a772-469a-b6ec-3e0307dad47c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:06.021454 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-44b74014-a772-469a-b6ec-3e0307dad47c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:06.021877 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-44b74014-a772-469a-b6ec-3e0307dad47c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:06.158249 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-44b74014-a772-469a-b6ec-3e0307dad47c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:06.169303 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-44b74014-a772-469a-b6ec-3e0307dad47c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1366 microversion: 2.1 time: 0.167798 Jul 11 21:13:06.170053 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 590/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:05 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:07.187424 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ef6d84f1-1da6-41ae-87e3-6655b6a6abd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:07.188088 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ef6d84f1-1da6-41ae-87e3-6655b6a6abd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:07.197617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef6d84f1-1da6-41ae-87e3-6655b6a6abd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:07.198083 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef6d84f1-1da6-41ae-87e3-6655b6a6abd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:07.198848 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef6d84f1-1da6-41ae-87e3-6655b6a6abd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:07.199278 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ef6d84f1-1da6-41ae-87e3-6655b6a6abd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:07.346133 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-ef6d84f1-1da6-41ae-87e3-6655b6a6abd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:07.354353 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ef6d84f1-1da6-41ae-87e3-6655b6a6abd1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1366 microversion: 2.1 time: 0.171516 Jul 11 21:13:07.354933 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 582/1172] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:07 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:08.371390 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-422392f2-eaf6-4a8c-9d9e-4502bf5e0e41 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:08.372048 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-422392f2-eaf6-4a8c-9d9e-4502bf5e0e41 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:08.379292 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-422392f2-eaf6-4a8c-9d9e-4502bf5e0e41 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:08.379755 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-422392f2-eaf6-4a8c-9d9e-4502bf5e0e41 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:08.380598 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-422392f2-eaf6-4a8c-9d9e-4502bf5e0e41 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:08.381042 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-422392f2-eaf6-4a8c-9d9e-4502bf5e0e41 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:08.521197 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-422392f2-eaf6-4a8c-9d9e-4502bf5e0e41 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:08.528937 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-422392f2-eaf6-4a8c-9d9e-4502bf5e0e41 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1366 microversion: 2.1 time: 0.161676 Jul 11 21:13:08.529521 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 591/1173] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:08 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:09.550261 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b374e56b-f758-461f-b384-2a82fc38c6ce tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:09.551356 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-b374e56b-f758-461f-b384-2a82fc38c6ce tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:09.562667 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b374e56b-f758-461f-b384-2a82fc38c6ce tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:09.563410 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b374e56b-f758-461f-b384-2a82fc38c6ce tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:09.564733 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b374e56b-f758-461f-b384-2a82fc38c6ce tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:09.565586 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-b374e56b-f758-461f-b384-2a82fc38c6ce tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:09.727708 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-b374e56b-f758-461f-b384-2a82fc38c6ce tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:09.739506 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b374e56b-f758-461f-b384-2a82fc38c6ce tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1366 microversion: 2.1 time: 0.196092 Jul 11 21:13:09.740058 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 583/1174] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:09 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:10.115747 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-d6ba777a-89cc-41bc-9791-c2706ba32cf2 req-f51282ef-e209-42b2-835f-dbaf5449cce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c42a450-8df4-41fa-90e9-7a630bcacb0c", "name": "network-vif-plugged", "status": "completed", "tag": "ac2aa586-139e-436c-a2e3-6e292448d83c"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:13:10.125074 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-d6ba777a-89cc-41bc-9791-c2706ba32cf2 req-f51282ef-e209-42b2-835f-dbaf5449cce5 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:10.125451 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-d6ba777a-89cc-41bc-9791-c2706ba32cf2 req-f51282ef-e209-42b2-835f-dbaf5449cce5 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:10.137328 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-d6ba777a-89cc-41bc-9791-c2706ba32cf2 req-f51282ef-e209-42b2-835f-dbaf5449cce5 service nova] Creating event network-vif-plugged:ac2aa586-139e-436c-a2e3-6e292448d83c for instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c on hv-cinder-84902 Jul 11 21:13:10.142406 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-d6ba777a-89cc-41bc-9791-c2706ba32cf2 req-f51282ef-e209-42b2-835f-dbaf5449cce5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030835 Jul 11 21:13:10.143013 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 592/1175] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:13:10.761463 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5b52642d-e5a6-456e-b0ec-55ab46423cee tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:10.762496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5b52642d-e5a6-456e-b0ec-55ab46423cee tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:10.772633 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b52642d-e5a6-456e-b0ec-55ab46423cee tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:10.773089 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b52642d-e5a6-456e-b0ec-55ab46423cee tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:10.773853 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b52642d-e5a6-456e-b0ec-55ab46423cee tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:10.774292 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5b52642d-e5a6-456e-b0ec-55ab46423cee tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:10.914238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-5b52642d-e5a6-456e-b0ec-55ab46423cee tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:10.926326 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5b52642d-e5a6-456e-b0ec-55ab46423cee tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1366 microversion: 2.1 time: 0.171047 Jul 11 21:13:10.927185 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 584/1176] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:10 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:11.948488 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:11.949528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell0:SELECT=6 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:11.956531 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b00f2160-94a9-4de6-9c76-4cc35e6051a1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:11.957218 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-b00f2160-94a9-4de6-9c76-4cc35e6051a1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:11.964314 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b00f2160-94a9-4de6-9c76-4cc35e6051a1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:11.964751 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b00f2160-94a9-4de6-9c76-4cc35e6051a1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:11.965497 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b00f2160-94a9-4de6-9c76-4cc35e6051a1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:11.965922 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-b00f2160-94a9-4de6-9c76-4cc35e6051a1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:12.095756 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-b00f2160-94a9-4de6-9c76-4cc35e6051a1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:13:12.103841 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b00f2160-94a9-4de6-9c76-4cc35e6051a1 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1557 microversion: 2.1 time: 0.158006 Jul 11 21:13:12.104425 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 593/1177] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:13:11 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:13:12.120649 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-7bbb55bf-9d47-48a1-b5be-6e70b9a03b04 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:13:12.121133 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-7bbb55bf-9d47-48a1-b5be-6e70b9a03b04 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:13:12.123122 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell0:SELECT=6 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:12.129660 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7bbb55bf-9d47-48a1-b5be-6e70b9a03b04 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:12.130109 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7bbb55bf-9d47-48a1-b5be-6e70b9a03b04 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:12.130870 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7bbb55bf-9d47-48a1-b5be-6e70b9a03b04 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:12.131304 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-7bbb55bf-9d47-48a1-b5be-6e70b9a03b04 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:12.218826 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-7bbb55bf-9d47-48a1-b5be-6e70b9a03b04 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102021 Jul 11 21:13:12.219747 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 585/1178] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jul 11 21:13:12 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:13:13.178510 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-179e191b-1312-4280-870f-a6ce592abe9a req-aef88108-b0f1-495e-bdb1-c77a44e16b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c42a450-8df4-41fa-90e9-7a630bcacb0c", "tag": "ac2aa586-139e-436c-a2e3-6e292448d83c"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:13:13.188452 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-179e191b-1312-4280-870f-a6ce592abe9a req-aef88108-b0f1-495e-bdb1-c77a44e16b29 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:13:13.188889 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-179e191b-1312-4280-870f-a6ce592abe9a req-aef88108-b0f1-495e-bdb1-c77a44e16b29 service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:13:13.200563 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-179e191b-1312-4280-870f-a6ce592abe9a req-aef88108-b0f1-495e-bdb1-c77a44e16b29 service nova] Creating event network-changed:ac2aa586-139e-436c-a2e3-6e292448d83c for instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c on hv-cinder-84902 Jul 11 21:13:13.205582 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-179e191b-1312-4280-870f-a6ce592abe9a req-aef88108-b0f1-495e-bdb1-c77a44e16b29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030852 Jul 11 21:13:13.206478 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 594/1179] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:08.989696 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-79a6d60b-dd3f-458b-bc95-08b28fd5e7f9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:08.990234 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-79a6d60b-dd3f-458b-bc95-08b28fd5e7f9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:08.992321 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-e780ea72-2dd1-4a80-86f3-889ac5e77419 req-2c1d751c-aaa8-4d55-964e-01080f0fdd9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bea7e51-186a-4c52-a94a-9470dc903c21", "tag": "e0b24542-e2ec-4ba9-8dad-b15749bd5e76"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:14:08.993383 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:08.994271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:08.997134 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:08.997857 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:09.001834 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-79a6d60b-dd3f-458b-bc95-08b28fd5e7f9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:09.002267 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-79a6d60b-dd3f-458b-bc95-08b28fd5e7f9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:09.003283 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-79a6d60b-dd3f-458b-bc95-08b28fd5e7f9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:09.003730 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-79a6d60b-dd3f-458b-bc95-08b28fd5e7f9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:09.003923 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-e780ea72-2dd1-4a80-86f3-889ac5e77419 req-2c1d751c-aaa8-4d55-964e-01080f0fdd9a service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:09.004525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-e780ea72-2dd1-4a80-86f3-889ac5e77419 req-2c1d751c-aaa8-4d55-964e-01080f0fdd9a service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:09.017730 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-e780ea72-2dd1-4a80-86f3-889ac5e77419 req-2c1d751c-aaa8-4d55-964e-01080f0fdd9a service nova] Creating event network-changed:e0b24542-e2ec-4ba9-8dad-b15749bd5e76 for instance 4bea7e51-186a-4c52-a94a-9470dc903c21 on hv-cinder-84902 Jul 11 21:14:09.024028 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-e780ea72-2dd1-4a80-86f3-889ac5e77419 req-2c1d751c-aaa8-4d55-964e-01080f0fdd9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035901 Jul 11 21:14:09.024734 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 595/1180] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:09.033069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-79a6d60b-dd3f-458b-bc95-08b28fd5e7f9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:14:09.128151 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-79a6d60b-dd3f-458b-bc95-08b28fd5e7f9 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 204 len: 0 microversion: 2.1 time: 0.142289 Jul 11 21:14:09.139683 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-83e13ba0-0bb0-43af-8052-4b195cc35c7a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:09.140213 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 586/1181] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:14:08 2022] DELETE /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:14:09.140410 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-83e13ba0-0bb0-43af-8052-4b195cc35c7a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:09.148639 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-83e13ba0-0bb0-43af-8052-4b195cc35c7a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:09.149407 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-83e13ba0-0bb0-43af-8052-4b195cc35c7a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:09.150190 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-83e13ba0-0bb0-43af-8052-4b195cc35c7a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:09.150621 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-83e13ba0-0bb0-43af-8052-4b195cc35c7a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:09.289968 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-83e13ba0-0bb0-43af-8052-4b195cc35c7a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:14:09.298812 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-83e13ba0-0bb0-43af-8052-4b195cc35c7a tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.164620 Jul 11 21:14:09.299466 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 596/1182] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:09 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:14:10.319814 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1845e8f8-75a4-443a-8e9b-0bc13d7a33d0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:10.320536 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1845e8f8-75a4-443a-8e9b-0bc13d7a33d0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:10.327073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1845e8f8-75a4-443a-8e9b-0bc13d7a33d0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:10.327515 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1845e8f8-75a4-443a-8e9b-0bc13d7a33d0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:10.328388 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1845e8f8-75a4-443a-8e9b-0bc13d7a33d0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:10.328811 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1845e8f8-75a4-443a-8e9b-0bc13d7a33d0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:10.503151 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-1845e8f8-75a4-443a-8e9b-0bc13d7a33d0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:14:10.515053 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1845e8f8-75a4-443a-8e9b-0bc13d7a33d0 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1569 microversion: 2.1 time: 0.201921 Jul 11 21:14:10.515893 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 587/1183] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:10 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:14:11.536988 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-727cba63-2b84-4fe1-ab50-6a4cffb39237 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:11.538356 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-727cba63-2b84-4fe1-ab50-6a4cffb39237 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:11.545389 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-727cba63-2b84-4fe1-ab50-6a4cffb39237 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:11.545833 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-727cba63-2b84-4fe1-ab50-6a4cffb39237 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:11.546978 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-727cba63-2b84-4fe1-ab50-6a4cffb39237 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:11.547390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-727cba63-2b84-4fe1-ab50-6a4cffb39237 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:11.602475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [req-681e3b7d-e522-4f03-9139-f8610a52f3cb req-f83cc6ca-1021-4ad2-ba31-d441752dcecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bea7e51-186a-4c52-a94a-9470dc903c21", "name": "network-vif-deleted", "tag": "e0b24542-e2ec-4ba9-8dad-b15749bd5e76"}]} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:14:11.611519 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-681e3b7d-e522-4f03-9139-f8610a52f3cb req-f83cc6ca-1021-4ad2-ba31-d441752dcecf service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:11.611958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [req-681e3b7d-e522-4f03-9139-f8610a52f3cb req-f83cc6ca-1021-4ad2-ba31-d441752dcecf service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:11.613326 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-727cba63-2b84-4fe1-ab50-6a4cffb39237 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3223a1d1dc1445c8b4aa118eb9747fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a26558aef284a9cbb955c7cdaa58e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:14:11.621561 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-727cba63-2b84-4fe1-ab50-6a4cffb39237 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 200 len: 1383 microversion: 2.1 time: 0.088616 Jul 11 21:14:11.622148 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 588/1184] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:11 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 1383 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:14:11.626919 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.compute.server_external_events [req-681e3b7d-e522-4f03-9139-f8610a52f3cb req-f83cc6ca-1021-4ad2-ba31-d441752dcecf service nova] Creating event network-vif-deleted:e0b24542-e2ec-4ba9-8dad-b15749bd5e76 for instance 4bea7e51-186a-4c52-a94a-9470dc903c21 on hv-cinder-84902 Jul 11 21:14:11.631665 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [req-681e3b7d-e522-4f03-9139-f8610a52f3cb req-f83cc6ca-1021-4ad2-ba31-d441752dcecf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104136 Jul 11 21:14:11.632378 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 597/1185] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:12.643563 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:12.644463 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] [instance: 4bea7e51-186a-4c52-a94a-9470dc903c21] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:12.653217 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:12.653664 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:12.654426 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:12.654861 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:12.668479 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] HTTP exception thrown: Instance 4bea7e51-186a-4c52-a94a-9470dc903c21 could not be found. Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Request method failure captured: Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 HTTP/1.1 Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJEihrJrTclLXUPHtqnDiDr-6tf7gitJkwHOyRqWdugL2XVF-QAP_W0hqd82rC3P_jhLkbjKiHLslzkXzB6vu_rRNgZPS-HhP00f9dK8ce3vlWbkG1AdcdKeXukNkMEBIZofrBod24XHICiF5mod-MlPyYIe45xuzkLZjhbQqwKXmxM Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 3a26558aef284a9cbb955c7cdaa58e4e Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-TestShelveInstance-1870988170 Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:14:12.670156 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a26558aef284a9cbb955c7cdaa58e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a26558aef284a9cbb955c7cdaa58e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a26558aef284a9cbb955c7cdaa58e4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a26558aef284a9cbb955c7cdaa58e4e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-TestShelveInstance-1870988170 Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 3a26558aef284a9cbb955c7cdaa58e4e Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-TestShelveInstance-1870988170 Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-TestShelveInstance-1870988170-project Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: e3223a1d1dc1445c8b4aa118eb9747fd Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-TestShelveInstance-1870988170-project Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 4bea7e51-186a-4c52-a94a-9470dc903c21 could not be found. Jul 11 21:14:12.672328 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '4bea7e51-186a-4c52-a94a-9470dc903c21'} Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bea7e51-186a-4c52-a94a-9470dc903c21 could not be found. Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:12.673238 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bea7e51-186a-4c52-a94a-9470dc903c21 could not be found. Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bea7e51-186a-4c52-a94a-9470dc903c21 could not be found. Jul 11 21:14:12.674585 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:12.675810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Returning 404 to user: Instance 4bea7e51-186a-4c52-a94a-9470dc903c21 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:12.675810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-1b526bcd-543e-4487-b690-5f6f27ac03fa tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21" status: 404 len: 111 microversion: 2.1 time: 0.035181 Jul 11 21:14:12.675810 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 589/1186] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:12 2022] GET /compute/v2.1/servers/4bea7e51-186a-4c52-a94a-9470dc903c21 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:12.842691 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-ed15df58-98d6-4523-b85c-1e7c0cbc5b31 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] Calling method '.version_select at 0x7f38406ffaf0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:12.864651 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-ed15df58-98d6-4523-b85c-1e7c0cbc5b31 tempest-TestShelveInstance-1870988170 tempest-TestShelveInstance-1870988170-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1019997444" status: 202 len: 0 microversion: 2.1 time: 0.025922 Jul 11 21:14:12.865412 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 598/1187] 10.222.0.20 () {58 vars in 1253 bytes} [Mon Jul 11 21:14:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1019997444 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:14:26.995566 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-5313dc1a-8860-4a75-ac5d-1bc71ead454b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:26.996177 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-5313dc1a-8860-4a75-ac5d-1bc71ead454b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:26.998706 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:26.999390 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:27.006862 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5313dc1a-8860-4a75-ac5d-1bc71ead454b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:27.007303 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5313dc1a-8860-4a75-ac5d-1bc71ead454b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:27.008077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5313dc1a-8860-4a75-ac5d-1bc71ead454b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:27.008868 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-5313dc1a-8860-4a75-ac5d-1bc71ead454b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:27.044913 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-5313dc1a-8860-4a75-ac5d-1bc71ead454b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/ips" status: 200 len: 150 microversion: 2.1 time: 0.056079 Jul 11 21:14:27.045500 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 590/1188] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 21:14:26 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:28.381368 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=10 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:28.382115 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:28.386412 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-58b9dda2-01e2-4dc1-9b5b-b93f94a36d7f tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4192d2d3-85cd-4a3d-bc12-10d06d459ce9"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:14:28.387554 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-58b9dda2-01e2-4dc1-9b5b-b93f94a36d7f tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:28.395764 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58b9dda2-01e2-4dc1-9b5b-b93f94a36d7f tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:28.396265 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58b9dda2-01e2-4dc1-9b5b-b93f94a36d7f tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:28.397058 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58b9dda2-01e2-4dc1-9b5b-b93f94a36d7f tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:28.397489 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-58b9dda2-01e2-4dc1-9b5b-b93f94a36d7f tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:28.674409 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-58b9dda2-01e2-4dc1-9b5b-b93f94a36d7f tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "POST /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294295 Jul 11 21:14:28.675020 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 599/1189] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jul 11 21:14:28 2022] POST /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:36.327334 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-af634c6c-3341-4ebc-bbc5-c37dda3db34b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:36.327817 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-af634c6c-3341-4ebc-bbc5-c37dda3db34b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:36.334126 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-af634c6c-3341-4ebc-bbc5-c37dda3db34b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:36.334569 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-af634c6c-3341-4ebc-bbc5-c37dda3db34b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:36.335320 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-af634c6c-3341-4ebc-bbc5-c37dda3db34b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:36.335745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-af634c6c-3341-4ebc-bbc5-c37dda3db34b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:36.419972 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.objects.instance [None req-af634c6c-3341-4ebc-bbc5-c37dda3db34b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lazy-loading 'services' on Instance uuid 8c42a450-8df4-41fa-90e9-7a630bcacb0c {{(pid=118014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 21:14:36.503107 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-af634c6c-3341-4ebc-bbc5-c37dda3db34b tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments/4192d2d3-85cd-4a3d-bc12-10d06d459ce9" status: 202 len: 0 microversion: 2.1 time: 0.179674 Jul 11 21:14:36.503709 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 591/1190] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jul 11 21:14:36 2022] DELETE /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments/4192d2d3-85cd-4a3d-bc12-10d06d459ce9 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:14:36.516010 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-1d0daedb-4c85-4247-b876-0dc8cdd343da tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:36.517051 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-1d0daedb-4c85-4247-b876-0dc8cdd343da tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:36.523515 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1d0daedb-4c85-4247-b876-0dc8cdd343da tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:36.523971 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1d0daedb-4c85-4247-b876-0dc8cdd343da tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:36.524802 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1d0daedb-4c85-4247-b876-0dc8cdd343da tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:36.525240 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-1d0daedb-4c85-4247-b876-0dc8cdd343da tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:36.558336 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-1d0daedb-4c85-4247-b876-0dc8cdd343da tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048214 Jul 11 21:14:36.559419 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 600/1191] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:14:36 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:37.572835 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-be769dc7-c3d3-4db3-889c-567292991c0e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:37.573905 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-be769dc7-c3d3-4db3-889c-567292991c0e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:37.580962 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be769dc7-c3d3-4db3-889c-567292991c0e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:37.581401 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be769dc7-c3d3-4db3-889c-567292991c0e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:37.582152 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be769dc7-c3d3-4db3-889c-567292991c0e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:37.582579 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-be769dc7-c3d3-4db3-889c-567292991c0e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:37.612397 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-be769dc7-c3d3-4db3-889c-567292991c0e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Jul 11 21:14:37.612963 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 592/1192] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:14:37 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:38.630480 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-0e8da740-95fe-4632-ac3e-de78eb2e1d8d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:38.631958 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-0e8da740-95fe-4632-ac3e-de78eb2e1d8d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:38.642778 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0e8da740-95fe-4632-ac3e-de78eb2e1d8d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:38.643518 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0e8da740-95fe-4632-ac3e-de78eb2e1d8d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:38.644843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0e8da740-95fe-4632-ac3e-de78eb2e1d8d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:38.645560 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-0e8da740-95fe-4632-ac3e-de78eb2e1d8d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:38.678421 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-0e8da740-95fe-4632-ac3e-de78eb2e1d8d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056272 Jul 11 21:14:38.678976 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 601/1193] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jul 11 21:14:38 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 21:14:38.754948 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-ed466068-65a1-43ca-b2f4-babd3e53c4aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:38.755475 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ed466068-65a1-43ca-b2f4-babd3e53c4aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:38.765164 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed466068-65a1-43ca-b2f4-babd3e53c4aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:38.765617 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed466068-65a1-43ca-b2f4-babd3e53c4aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:38.766451 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed466068-65a1-43ca-b2f4-babd3e53c4aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:38.766812 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-ed466068-65a1-43ca-b2f4-babd3e53c4aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:38.792828 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-ed466068-65a1-43ca-b2f4-babd3e53c4aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Going to try to terminate instance {{(pid=118014) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 21:14:38.880873 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-ed466068-65a1-43ca-b2f4-babd3e53c4aa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 204 len: 0 microversion: 2.1 time: 0.131512 Jul 11 21:14:38.881448 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 593/1194] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:14:38 2022] DELETE /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 21:14:38.890094 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a6390a2d-b327-4241-a722-972fe356c71e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:38.890730 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-a6390a2d-b327-4241-a722-972fe356c71e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:38.897319 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6390a2d-b327-4241-a722-972fe356c71e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:38.897764 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6390a2d-b327-4241-a722-972fe356c71e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:38.898523 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6390a2d-b327-4241-a722-972fe356c71e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:38.898953 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-a6390a2d-b327-4241-a722-972fe356c71e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:39.032980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-a6390a2d-b327-4241-a722-972fe356c71e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:14:39.040792 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a6390a2d-b327-4241-a722-972fe356c71e tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1681 microversion: 2.1 time: 0.154800 Jul 11 21:14:39.041354 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 602/1195] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:38 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:14:40.063365 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a83da5ef-d9db-49f1-800d-fde8a522ad9d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:40.064558 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a83da5ef-d9db-49f1-800d-fde8a522ad9d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:40.075669 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a83da5ef-d9db-49f1-800d-fde8a522ad9d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:40.076251 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a83da5ef-d9db-49f1-800d-fde8a522ad9d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:40.077023 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a83da5ef-d9db-49f1-800d-fde8a522ad9d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:40.077487 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a83da5ef-d9db-49f1-800d-fde8a522ad9d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:40.215295 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.policy [None req-a83da5ef-d9db-49f1-800d-fde8a522ad9d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118014) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:14:40.223324 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a83da5ef-d9db-49f1-800d-fde8a522ad9d tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1681 microversion: 2.1 time: 0.167407 Jul 11 21:14:40.223903 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 594/1196] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:40 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:14:41.243211 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-8ac6bfd9-ea8b-4b63-9bc7-1e0b28260232 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:41.243822 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-8ac6bfd9-ea8b-4b63-9bc7-1e0b28260232 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:41.251655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8ac6bfd9-ea8b-4b63-9bc7-1e0b28260232 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:41.252128 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8ac6bfd9-ea8b-4b63-9bc7-1e0b28260232 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:41.252925 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8ac6bfd9-ea8b-4b63-9bc7-1e0b28260232 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:41.253360 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-8ac6bfd9-ea8b-4b63-9bc7-1e0b28260232 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:41.390440 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.policy [None req-8ac6bfd9-ea8b-4b63-9bc7-1e0b28260232 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f6997db7c141529c37cc64955df779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a8791815f40f98ed1e81e58b01fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118013) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 21:14:41.398075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-8ac6bfd9-ea8b-4b63-9bc7-1e0b28260232 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 200 len: 1681 microversion: 2.1 time: 0.159013 Jul 11 21:14:41.398818 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 603/1197] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:41 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 21:14:41.742316 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [req-37874f6d-feff-46e8-8580-301bfef9c4ee req-e48921a9-313c-4854-a2cd-35818b696e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c42a450-8df4-41fa-90e9-7a630bcacb0c", "name": "network-vif-deleted", "tag": "ac2aa586-139e-436c-a2e3-6e292448d83c"}]} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:14:41.752940 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-37874f6d-feff-46e8-8580-301bfef9c4ee req-e48921a9-313c-4854-a2cd-35818b696e8a service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:41.753548 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [req-37874f6d-feff-46e8-8580-301bfef9c4ee req-e48921a9-313c-4854-a2cd-35818b696e8a service nova] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:41.765359 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.compute.server_external_events [req-37874f6d-feff-46e8-8580-301bfef9c4ee req-e48921a9-313c-4854-a2cd-35818b696e8a service nova] Creating event network-vif-deleted:ac2aa586-139e-436c-a2e3-6e292448d83c for instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c on hv-cinder-84902 Jul 11 21:14:41.771032 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [req-37874f6d-feff-46e8-8580-301bfef9c4ee req-e48921a9-313c-4854-a2cd-35818b696e8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032771 Jul 11 21:14:41.771880 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 595/1198] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jul 11 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:42.418934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:42.419590 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:42.427760 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:42.428262 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:42.429078 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:42.429445 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:42.444380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c HTTP/1.1 Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:14:42.446140 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:42.447896 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '8c42a450-8df4-41fa-90e9-7a630bcacb0c'} Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:42.448967 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:42.450545 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:42.451740 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:42.451740 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-83993bbb-d8c3-4552-8fdc-cef195834c40 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 404 len: 111 microversion: 2.1 time: 0.034605 Jul 11 21:14:42.451740 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 604/1199] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:42 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:42.457857 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4cd37606-17e9-45af-9ae9-a1bbe897cc3a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '.version_select at 0x7f38400c0550>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:42.478535 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4cd37606-17e9-45af-9ae9-a1bbe897cc3a tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848477452" status: 202 len: 0 microversion: 2.1 time: 0.024832 Jul 11 21:14:42.479455 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 596/1200] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jul 11 21:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848477452 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:14:44.295696 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:44.296934 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:44.305331 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:44.305779 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:44.306590 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:44.307022 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:44.323614 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: DELETE /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c HTTP/1.1 Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:14:44.325233 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.326972 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '8c42a450-8df4-41fa-90e9-7a630bcacb0c'} Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:44.327881 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.329493 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.331027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:44.331027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-91e92216-4ffc-4cc2-9c1d-6980a2164d38 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 404 len: 111 microversion: 2.1 time: 0.036410 Jul 11 21:14:44.331027 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 605/1201] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:14:44 2022] DELETE /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:44.335741 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:44.336542 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8c42a450-8df4-41fa-90e9-7a630bcacb0c] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:44.344856 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:44.345307 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:44.346076 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:44.346514 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:44.360734 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c HTTP/1.1 Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:14:44.362408 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.364077 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '8c42a450-8df4-41fa-90e9-7a630bcacb0c'} Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:44.365069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. Jul 11 21:14:44.366496 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:44.368185 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 8c42a450-8df4-41fa-90e9-7a630bcacb0c could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:44.368185 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-c2900398-2a0d-408e-be11-eb53c1febd22 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c" status: 404 len: 111 microversion: 2.1 time: 0.032316 Jul 11 21:14:44.368185 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 597/1202] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:44 2022] GET /compute/v2.1/servers/8c42a450-8df4-41fa-90e9-7a630bcacb0c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:45.513897 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:45.514415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:45.521422 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:45.521867 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:45.522617 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:45.523044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:45.536947 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: DELETE /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 HTTP/1.1 Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:14:45.538486 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.540055 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '8bf1bbec-8b13-42a5-aa9f-18029e20d2f4'} Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:45.541024 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.542539 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.544034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:45.544034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-6403cba1-524a-4792-9d7b-d8f2e24ca424 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 404 len: 111 microversion: 2.1 time: 0.029934 Jul 11 21:14:45.544034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 606/1203] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:14:45 2022] DELETE /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:45.548879 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:45.549494 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:45.556606 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:45.557047 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:45.557793 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:45.558215 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:45.574760 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 HTTP/1.1 Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:14:45.576502 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.578187 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '8bf1bbec-8b13-42a5-aa9f-18029e20d2f4'} Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:45.579135 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. Jul 11 21:14:45.580699 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.582020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:45.582020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a16db419-e384-440b-8856-75ea639d9baa tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4" status: 404 len: 111 microversion: 2.1 time: 0.033232 Jul 11 21:14:45.582020 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 598/1204] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:45 2022] GET /compute/v2.1/servers/8bf1bbec-8b13-42a5-aa9f-18029e20d2f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:45.586295 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:45.586845 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:45.593655 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:45.594100 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:45.594864 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:45.595284 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:45.609599 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: DELETE /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 HTTP/1.1 Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:14:45.611131 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.612724 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '861d2bea-e420-47e3-95f6-6dcfde4e7d88'} Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:45.613623 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.615034 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.617263 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:45.617263 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2f51b761-b934-4d32-a156-d24617652b16 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 404 len: 111 microversion: 2.1 time: 0.030085 Jul 11 21:14:45.617263 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 607/1205] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:14:45 2022] DELETE /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:45.625960 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:45.626574 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 861d2bea-e420-47e3-95f6-6dcfde4e7d88] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:45.633101 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:45.633523 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:45.634284 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:45.634745 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:45.648601 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 HTTP/1.1 Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:14:45.650120 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.651725 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '861d2bea-e420-47e3-95f6-6dcfde4e7d88'} Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:45.652584 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. Jul 11 21:14:45.654091 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:45.655693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 861d2bea-e420-47e3-95f6-6dcfde4e7d88 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:45.655693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-813c8463-da12-4873-aa9b-1855ab3ca28c tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88" status: 404 len: 111 microversion: 2.1 time: 0.030428 Jul 11 21:14:45.655693 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 599/1206] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:45 2022] GET /compute/v2.1/servers/861d2bea-e420-47e3-95f6-6dcfde4e7d88 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:46.803170 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:46.803730 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.compute.api [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118013) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:46.810824 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:46.811044 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:46.811817 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:46.812851 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG oslo_concurrency.lockutils [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:46.826619 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: DELETE /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 HTTP/1.1 Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:14:46.828376 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: > Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.830380 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': '1a34d34e-5069-4a9b-bd8e-aee28a2e4668'} Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:46.831260 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.832885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.834657 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:46.834657 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-2b3dcc9b-da11-4b6b-b34a-18a6752c87a4 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 404 len: 111 microversion: 2.1 time: 0.030682 Jul 11 21:14:46.834657 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 608/1207] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jul 11 21:14:46 2022] DELETE /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:46.839349 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Calling method '>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:46.840046 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.compute.api [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] [instance: 1a34d34e-5069-4a9b-bd8e-aee28a2e4668] Fetching instance by UUID {{(pid=118014) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 21:14:46.847171 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:46.847620 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:46.848422 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 21:14:46.848860 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG oslo_concurrency.lockutils [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Lock "2e1024e7-6872-42da-8de2-23153914318d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 21:14:46.863024 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] HTTP exception thrown: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Request method failure captured: Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 HTTP/1.1 Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJCkwKmHgVepbjVtmoDzfhoHkUKMhjO6JMDqhX9bQL6sWB6YCh7qHk6dI6LMhhX5AbqvdLOPbC6GL86gdWAIoGADTxokNHas_Um8Xp5A1RoiqOU7uE08hq3n14EBqQrTpZ825FW9DfLxKYs7GGmRPVk9rVMvBu_b4714SeGHm_fRwJo Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:14:46.864597 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b85a8791815f40f98ed1e81e58b01fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b85a8791815f40f98ed1e81e58b01fd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: b85a8791815f40f98ed1e81e58b01fd6 Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1340396144 Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: 68f6997db7c141529c37cc64955df779 Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-AttachVolumeNegativeTest-1340396144-project Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: > Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.866242 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': '1a34d34e-5069-4a9b-bd8e-aee28a2e4668'} Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:46.867102 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. Jul 11 21:14:46.868427 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:46.869573 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] Returning 404 to user: Instance 1a34d34e-5069-4a9b-bd8e-aee28a2e4668 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:46.869573 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-75ac1d48-9a0e-4db5-8f7a-8eedb755ce10 tempest-AttachVolumeNegativeTest-1340396144 tempest-AttachVolumeNegativeTest-1340396144-project] 10.222.0.20 "GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668" status: 404 len: 111 microversion: 2.1 time: 0.030627 Jul 11 21:14:46.869573 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 600/1208] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jul 11 21:14:46 2022] GET /compute/v2.1/servers/1a34d34e-5069-4a9b-bd8e-aee28a2e4668 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:51.556571 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-c67b5c94-1e18-487f-88c0-142986d77043 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Action: 'create', calling method: .version_select at 0x7f38403999d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-217780737"}} {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:14:51.858601 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-c67b5c94-1e18-487f-88c0-142986d77043 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.434956 Jul 11 21:14:51.859207 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 609/1209] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Jul 11 21:14:51 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 21:14:51.870451 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-3e0f3cb6-93fb-4296-ab14-63164a2569e6 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3840501c10>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:51.919069 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-3e0f3cb6-93fb-4296-ab14-63164a2569e6 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d" status: 200 len: 344 microversion: 2.1 time: 0.052234 Jul 11 21:14:51.919808 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 601/1210] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 21:14:51 2022] GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:52.937191 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-65c063a6-909f-4e16-8838-869275aa1ef0 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f38403833a0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:52.990088 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-65c063a6-909f-4e16-8838-869275aa1ef0 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d" status: 200 len: 345 microversion: 2.1 time: 0.060149 Jul 11 21:14:52.990671 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 610/1211] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 21:14:52 2022] GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:53.002255 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-9b37ee77-5f06-44c6-adb2-660fd27cb222 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Action: 'create', calling method: .version_select at 0x7f38406113a0>, body: {"snapshot": {"volume_id": "c81688b2-3d67-45bf-a7a7-23047ad39e2d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1771126746"}} {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 21:14:53.158438 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-9b37ee77-5f06-44c6-adb2-660fd27cb222 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.160449 Jul 11 21:14:53.159114 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 602/1212] 10.222.0.20 () {60 vars in 1161 bytes} [Mon Jul 11 21:14:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:53.169872 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-4522e5d5-e208-4b52-8c1c-443945645fc3 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f38406ff820>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:53.202820 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-4522e5d5-e208-4b52-8c1c-443945645fc3 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201" status: 200 len: 287 microversion: 2.1 time: 0.036894 Jul 11 21:14:53.203394 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 611/1213] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jul 11 21:14:53 2022] GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:53.214972 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-769296b1-f0de-4000-96eb-ec1d5874522f tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3843ac95e0>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:53.245607 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-769296b1-f0de-4000-96eb-ec1d5874522f tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034450 Jul 11 21:14:53.246179 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 603/1214] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Jul 11 21:14:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:53.256393 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-3484b1e2-477b-4d0d-a96e-87b020daa716 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3840229e50>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:53.286525 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-3484b1e2-477b-4d0d-a96e-87b020daa716 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201" status: 200 len: 287 microversion: 2.1 time: 0.033993 Jul 11 21:14:53.287120 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 612/1215] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jul 11 21:14:53 2022] GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:54.302741 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-bdf994bc-a149-44bb-8673-a52e4f167ce5 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f384040ed30>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:54.337867 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-bdf994bc-a149-44bb-8673-a52e4f167ce5 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201" status: 200 len: 287 microversion: 2.1 time: 0.041728 Jul 11 21:14:54.338430 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 604/1216] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jul 11 21:14:54 2022] GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:55.354839 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e2d6ab96-3635-4a67-9397-957a986e61df tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3840107af0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:55.395833 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e2d6ab96-3635-4a67-9397-957a986e61df tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201" status: 200 len: 287 microversion: 2.1 time: 0.048320 Jul 11 21:14:55.396437 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 613/1217] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jul 11 21:14:55 2022] GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:56.414874 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-b140bedf-5e60-4108-9dfb-db428ad5c863 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3840534e50>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:56.449262 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-b140bedf-5e60-4108-9dfb-db428ad5c863 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201" status: 200 len: 287 microversion: 2.1 time: 0.043280 Jul 11 21:14:56.449831 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 605/1218] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jul 11 21:14:56 2022] GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:57.459850 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_api:SELECT=20 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:57.460640 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG dbcounter [-] [118013] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:57.464902 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-a8e1bac8-7ef8-44e2-9235-c37c4a51d297 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3840229dc0>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:57.507008 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-a8e1bac8-7ef8-44e2-9235-c37c4a51d297 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201" status: 200 len: 288 microversion: 2.1 time: 0.048479 Jul 11 21:14:57.507615 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 614/1219] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jul 11 21:14:57 2022] GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 => generated 288 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:57.515040 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:57.515805 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG dbcounter [-] [118014] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:57.520618 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4ed632f1-3d20-408e-820f-77444c1c9b1b tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3840259b80>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:57.594849 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4ed632f1-3d20-408e-820f-77444c1c9b1b tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201" status: 202 len: 0 microversion: 2.1 time: 0.080301 Jul 11 21:14:57.595631 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 606/1220] 10.222.0.20 () {58 vars in 1253 bytes} [Mon Jul 11 21:14:57 2022] DELETE /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:14:57.605617 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-bdb2167f-3792-4f84-9221-cbc5acc6e51f tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f38406ff700>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:57.642130 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-bdb2167f-3792-4f84-9221-cbc5acc6e51f tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201" status: 200 len: 287 microversion: 2.1 time: 0.040344 Jul 11 21:14:57.642787 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 615/1221] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jul 11 21:14:57 2022] GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:58.659532 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a6805da8-c313-4761-b429-7a4f054cb475 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f384007e430>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:58.691619 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-a6805da8-c313-4761-b429-7a4f054cb475 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] HTTP exception thrown: Snapshot ff5eef78-19a4-4e80-9c80-c56da8874201 could not be found. Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a6805da8-c313-4761-b429-7a4f054cb475 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Request method failure captured: Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 HTTP/1.1 Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJLLw3iURaJ-HeAB9bOrKhOl5vF3_1s02GPX5XOb_gIliLTAgFTqRiMkKEyBf1H7sq35TPGz6CJePYv1HPOuafucTL9ZXPwp-r2avrbTxEPVOd1dbi1OVIzwcvX1ckYJKMYBFDeaMp3w_ijmQs9giAhMRMaKJzcC4wfhv3uNKI0TI8A Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 6330a6c7b6a74599ad9c4ca8ebf8fa75 Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:14:58.694917 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6330a6c7b6a74599ad9c4ca8ebf8fa75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 6330a6c7b6a74599ad9c4ca8ebf8fa75 Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-VolumesSnapshotsTestJSON-1546238122-project Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: c02cb425c9904c238b9ae72049722c55 Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1546238122-project Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Snapshot ff5eef78-19a4-4e80-9c80-c56da8874201 could not be found. Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': 'ff5eef78-19a4-4e80-9c80-c56da8874201'} Jul 11 21:14:58.696593 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ff5eef78-19a4-4e80-9c80-c56da8874201 could not be found. (HTTP 404) (Request-ID: req-39b4762c-8a95-4e7b-a443-1279452ce7a1) Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:58.697673 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 21:14:58.698915 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ff5eef78-19a4-4e80-9c80-c56da8874201 could not be found. Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 11 21:14:58.700265 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ff5eef78-19a4-4e80-9c80-c56da8874201 could not be found. Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ff5eef78-19a4-4e80-9c80-c56da8874201 could not be found. Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a6805da8-c313-4761-b429-7a4f054cb475 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Returning 404 to user: Snapshot ff5eef78-19a4-4e80-9c80-c56da8874201 could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:58.701560 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a6805da8-c313-4761-b429-7a4f054cb475 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201" status: 404 len: 111 microversion: 2.1 time: 0.044048 Jul 11 21:14:58.702444 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 607/1222] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jul 11 21:14:58 2022] GET /compute/v2.1/os-snapshots/ff5eef78-19a4-4e80-9c80-c56da8874201 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:58.705566 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-cef235b3-0668-4890-a5cd-f30c8f3ef1a5 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3841069550>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:58.779339 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-cef235b3-0668-4890-a5cd-f30c8f3ef1a5 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d" status: 202 len: 0 microversion: 2.1 time: 0.077953 Jul 11 21:14:58.779928 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 616/1223] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 21:14:58 2022] DELETE /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 21:14:58.788146 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-a0a86f3d-6051-47f4-8de7-ba638037a9db tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3843ac7310>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:58.841930 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-a0a86f3d-6051-47f4-8de7-ba638037a9db tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d" status: 200 len: 344 microversion: 2.1 time: 0.057546 Jul 11 21:14:58.842508 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 608/1224] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 21:14:58 2022] GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 21:14:59.855898 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b62e5386-197d-4239-a487-f01ece63a5e6 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f38406f0820>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:59.885411 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-b62e5386-197d-4239-a487-f01ece63a5e6 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] HTTP exception thrown: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b62e5386-197d-4239-a487-f01ece63a5e6 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Request method failure captured: Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d HTTP/1.1 Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJLLw3iURaJ-HeAB9bOrKhOl5vF3_1s02GPX5XOb_gIliLTAgFTqRiMkKEyBf1H7sq35TPGz6CJePYv1HPOuafucTL9ZXPwp-r2avrbTxEPVOd1dbi1OVIzwcvX1ckYJKMYBFDeaMp3w_ijmQs9giAhMRMaKJzcC4wfhv3uNKI0TI8A Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 6330a6c7b6a74599ad9c4ca8ebf8fa75 Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:14:59.887359 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6330a6c7b6a74599ad9c4ca8ebf8fa75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 6330a6c7b6a74599ad9c4ca8ebf8fa75 Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesSnapshotsTestJSON-1546238122-project Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: c02cb425c9904c238b9ae72049722c55 Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1546238122-project Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'c81688b2-3d67-45bf-a7a7-23047ad39e2d'} Jul 11 21:14:59.888980 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. (HTTP 404) (Request-ID: req-12a29c3b-8dae-4050-8f4c-0cf8db177440) Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:59.889884 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 21:14:59.891093 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 21:14:59.893182 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-b62e5386-197d-4239-a487-f01ece63a5e6 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Returning 404 to user: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-b62e5386-197d-4239-a487-f01ece63a5e6 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d" status: 404 len: 109 microversion: 2.1 time: 0.037337 Jul 11 21:14:59.894559 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 617/1225] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 21:14:59 2022] GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:59.903944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4bb2e6a1-4507-496e-b966-e3f9faa36ab9 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3840501430>' {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:59.931896 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.wsgi [None req-4bb2e6a1-4507-496e-b966-e3f9faa36ab9 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] HTTP exception thrown: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4bb2e6a1-4507-496e-b966-e3f9faa36ab9 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Request method failure captured: Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: request: DELETE /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d HTTP/1.1 Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept: application/json Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Accept-Encoding: identity Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Connection: close Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Length: 0 Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Content-Type: application/json Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Host: 10.222.0.20 Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Openstack-System-Scope: None Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Auth-Token: gAAAAABizJLLw3iURaJ-HeAB9bOrKhOl5vF3_1s02GPX5XOb_gIliLTAgFTqRiMkKEyBf1H7sq35TPGz6CJePYv1HPOuafucTL9ZXPwp-r2avrbTxEPVOd1dbi1OVIzwcvX1ckYJKMYBFDeaMp3w_ijmQs9giAhMRMaKJzcC4wfhv3uNKI0TI8A Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Id: None Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Domain-Name: None Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Identity-Status: Confirmed Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Is-Admin-Project: True Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Id: default Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Domain-Name: Default Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Id: 6330a6c7b6a74599ad9c4ca8ebf8fa75 Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Role: member,reader Jul 11 21:14:59.934271 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Roles: member,reader Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6330a6c7b6a74599ad9c4ca8ebf8fa75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Id: 6330a6c7b6a74599ad9c4ca8ebf8fa75 Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User: tempest-VolumesSnapshotsTestJSON-1546238122-project Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Id: default Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Domain-Name: Default Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Id: c02cb425c9904c238b9ae72049722c55 Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1546238122-project Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: method: Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: exception: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: action_args: {'id': 'c81688b2-3d67-45bf-a7a7-23047ad39e2d'} Jul 11 21:14:59.936073 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: {{(pid=118014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. (HTTP 404) (Request-ID: req-51e39b2a-4617-4aae-82d1-7519b12e5469) Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:59.937363 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 21:14:59.938902 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 21:14:59.940513 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: DEBUG nova.api.openstack.wsgi [None req-4bb2e6a1-4507-496e-b966-e3f9faa36ab9 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Returning 404 to user: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. {{(pid=118014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:59.942005 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO nova.api.openstack.requestlog [None req-4bb2e6a1-4507-496e-b966-e3f9faa36ab9 tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d" status: 404 len: 109 microversion: 2.1 time: 0.036435 Jul 11 21:14:59.943206 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: [pid: 118014|app: 0|req: 609/1226] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jul 11 21:14:59 2022] DELETE /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:14:59.946575 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e4d2b497-7bac-4098-ab41-d587a895799f tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Calling method '.version_select at 0x7f3840229e50>' {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 21:14:59.975663 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.wsgi [None req-e4d2b497-7bac-4098-ab41-d587a895799f tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] HTTP exception thrown: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e4d2b497-7bac-4098-ab41-d587a895799f tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Request method failure captured: Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: request: GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d HTTP/1.1 Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept: application/json Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Accept-Encoding: identity Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Connection: close Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Length: 0 Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Content-Type: application/json Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Host: 10.222.0.20 Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Openstack-System-Scope: None Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: User-Agent: python-urllib3/1.26.9 Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Auth-Token: gAAAAABizJLLw3iURaJ-HeAB9bOrKhOl5vF3_1s02GPX5XOb_gIliLTAgFTqRiMkKEyBf1H7sq35TPGz6CJePYv1HPOuafucTL9ZXPwp-r2avrbTxEPVOd1dbi1OVIzwcvX1ckYJKMYBFDeaMp3w_ijmQs9giAhMRMaKJzcC4wfhv3uNKI0TI8A Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Id: None Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Domain-Name: None Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Identity-Status: Confirmed Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Is-Admin-Project: True Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Id: default Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Domain-Name: Default Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Id: 6330a6c7b6a74599ad9c4ca8ebf8fa75 Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Role: member,reader Jul 11 21:14:59.977632 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Roles: member,reader Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6330a6c7b6a74599ad9c4ca8ebf8fa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6330a6c7b6a74599ad9c4ca8ebf8fa75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Id: 6330a6c7b6a74599ad9c4ca8ebf8fa75 Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1546238122 Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User: tempest-VolumesSnapshotsTestJSON-1546238122-project Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Id: default Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Domain-Name: Default Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Id: c02cb425c9904c238b9ae72049722c55 Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1546238122-project Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: method: Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: exception: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: action_args: {'id': 'c81688b2-3d67-45bf-a7a7-23047ad39e2d'} Jul 11 21:14:59.979135 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: {{(pid=118013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. (HTTP 404) (Request-ID: req-63b51227-0f2b-4e1d-a8b2-0d3fe3b8369c) Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:59.980415 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 21:14:59.981885 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 21:14:59.983507 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: ERROR nova.api.openstack.wsgi Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: DEBUG nova.api.openstack.wsgi [None req-e4d2b497-7bac-4098-ab41-d587a895799f tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] Returning 404 to user: Volume c81688b2-3d67-45bf-a7a7-23047ad39e2d could not be found. {{(pid=118013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO nova.api.openstack.requestlog [None req-e4d2b497-7bac-4098-ab41-d587a895799f tempest-VolumesSnapshotsTestJSON-1546238122 tempest-VolumesSnapshotsTestJSON-1546238122-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d" status: 404 len: 109 microversion: 2.1 time: 0.037644 Jul 11 21:14:59.985075 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: [pid: 118013|app: 0|req: 618/1227] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jul 11 21:14:59 2022] GET /compute/v2.1/os-volumes/c81688b2-3d67-45bf-a7a7-23047ad39e2d => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 21:15:52.328704 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:15:52.328704 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Mon Jul 11 21:15:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:17:31.005944 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:17:31.006832 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Mon Jul 11 21:17:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:17:54.227380 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:17:54.228494 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Mon Jul 11 21:17:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:19:12.342528 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:19:12.343475 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Mon Jul 11 21:19:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:19:14.986778 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:19:14.987647 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Mon Jul 11 21:19:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:19:36.486533 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:19:36.487843 dv-cinder-849022-2-iscsi devstack@n-api.service[118013]: Mon Jul 11 21:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:19:43.478062 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:19:43.478690 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Mon Jul 11 21:19:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:20:51.020071 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:20:51.021111 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Mon Jul 11 21:20:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 21:21:14.240564 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 21:21:14.241309 dv-cinder-849022-2-iscsi devstack@n-api.service[118014]: Mon Jul 11 21:21:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!